You are being gaslighted by your boyfriend. He's making you doubt reality by lying and manipulating you, by making you seem the abuser. He is abusive, as is the other boyfriend.
Here's a helpful article on the subject. Please read the warning signs - your post has most of them:
I beg you to leave him. It's only going to get worse. You deserve better. You are not at fault and you are not stupid. Do whatever you have to to leave the relationship. Ultimately, you will be infinitely better off.