From food at Katz Deli to adventures on Governor's Island, here are some of the best budget-friendly spots in the city according to a local.