Learning when to cut back peonies, both the flowers and the foliage, is an important gardening maintenance step for a healthy plant.