Honestly... this doesn't sound like a polyamorous relationship!!
Poly relationships are MUTUAL agreements... not a one sided "hall pass" to cheat. If you are unhappy, then it's NOT working and he IS cheating.
If you'd like to talk, feel free to message me on here or email me: firstname.lastname@example.org