This peaceful fishing village is famous for its annual pony swim, but also features delicious local seafood, a national wildlife refuge, shopping, and family activities.