He doesn't sound very ethical, I'm not sure what you can do about that since his actions ultimately belong to him.
If he isn't by choice ethical, can he be? Have you either read The Ethical Slut?
Do you need to be with him? Do you just want to be with him?
And, conversely, does he, with you? It's not like you've been acting unethically, have you?