I don't see why you can't have all that with your husband AND your boyfriend, and for your husband to have a girlfriend. Why must it be either/or? You are feeling like you did something wrong, but is that just a cover, a way to handle your jealousy? Poly enabled you to get to where you are now, why toss it because you "don't want to share?" This too shall pass.
What a wonderful life to be able to have such an expanse of love in so many directions!