The 61-year-old actor responded to the claims during an appearance on the Late Show With Stephen Colbert alongside his White Plumbers co-star Justin Theroux on Tuesday night.
