"Modern Family" is one of those shows where the actors are not [on set] every single day, so it was easier for me growing up," the former child star said.