Try not to compare what they have to what you have with him. It sounds to me that poly isn't the issue here although it might have surfaced some things that were there already. Find some time to talk things through with him and start dealing with the issues that are causing fights between the two of you.
Everything will be ok in the end. If it's not ok it's not the end.