It actually is a big deal, a very big deal. He is too controlling and frankly people like this usually just get worse.

Set some ground rules and get the password immediately and then change it so only you know the password. If he won’t give it to you right away please please talk to someone about next steps.