Yikes!! If you aren't getting time to see him, then how are you a part of the relationship? I don't mean to sound crass, but I only have my own personal experience in the lifestyle to go against, and keeping either of the girls out of the loop was never an option. Again, we have a different set up than some others here so I'm not all knowing.
Everyone's gotta be happy and right now you're not. I also don't get the vibe that bf and gf2 are doing their part to make you happy. No one can feel neglected if this is going to work out.
Live life to the fullest 'cause you never know if you're gonna wake up tomorrow!