'I'm not bossy. I'm the boss.'
Sometimes people don't totally understand the distinction, but that's not your problem.