A classic cottage garden favorite, perennial peonies are showstoppers in the late spring. Give them full sun, well-drained soil and a commitment; many cultivars will live a hundred years if they're happy.