So, your issue is that you resent that he can tell you to stop your relationships, and you can't tell him to do so?
Firstly, no one can "make" anyone do or feel anything. It's a personal choice on how to react to a situation. You chose to end the relationships after he asked you. But you could always refuse if you liked.
Still, you specifically said that yours "had to end due to their secretive nature," whereas his was begun open and honestly.
So, yeah, you could refuse to give up your affairs, but frankly that doesn't show a lot of respect for yourself or for him.
Is there something else to the story that you're not sharing that would put a different light to this?