Infusing milk with lavender buds perfumes the honey-sweetened custard, creating an unusual, lovely backdrop for juicy plums. A quick pass under the broiler caramelizes the top. Note: Because the custard is stabilized with cornstarch, you can let it reach a gentle simmer.