I live open poly with my children, husband and boyfriend. That has resulted in some drama with dh's exwife and their son (now 16 yo).
I agree with GG.
YOU have boundaries-you are responsible to ensure that they are enforced for yourself.
If partners aren't willing to respect boundaries-they don't respect you.
"Love As Thou Wilt"