A sign company installed the quirky signs on Fifth Avenue without permission, so the grocery store management took them down on Tuesday.