The TV judge spoke out after fans of the hit BBC2 show pointed to an on-screen flirtation between him and former model Tandoh.