This California town might be tiny, but it has lots of charm and makes for a good base to explore both the tallest and lowest elevations in the contiguous U.S.