Obviously talking is the most obvious step you could take to at least express how you feel. You didn’t mention any of this in your message to me, so I assume you haven’t spoken to him about this? Maybe you have, but he becomes very closed and defensive whenever you bring it up?