Well I appreciate that. It does sound like you need to clear the air with your boyfriend, first of all because maybe you need him to do a little more to rebuild the trust, and second because it's a poly relationship which is a somewhat different dynamic than a monogamous relationship.
I'm sure you guys will get your chance to talk. Ask him to set a time for it, if that would help facilitate things.
Best wishes to you,
Love means never having to say, "Put down that meat cleaver!"