I just wanted to add my voice to the others: you are being REASONABLE.
His behavior is filled with red flags. Either he is trying, subconsciously or otherwise, to drive you away...or he is utterly selfish and lacks respect for you.
I'm really sorry, and I think everyone on the forum would agree that it hurts when something like this makes you see a person in a certain way. But I also think it's necessary to see clearly. Think as quietly and dispassionately as you can about whether he is someone you want to have in your life at all.
Trust is HUGE. To me it's at the center of any functional relationship. If he can't be trusted then what's left? What ground can the relationship stand on?