New Bedford has hosted seamen from the world over and served as a haven for Southern slaves as part of the Underground Railroad.