Stephen Merchant says he only found out when a TV costume department worker was told ‘We’re not selling clothes to him'.