Managers, like children, frequently lack the cognitive capacity to envisage their staff doing anything other than work. Especially when they aren't working. When you inform them you have hobbies or do things like sleep, they will be startled and upset. Because this management didn't seem to understand what 'I'm busy' meant to him, he decided