At the end of the day, family is all we’ve got. But some managers can't stand you not putting your job first.