NRE and poly brings out the cracks in your primary/established relationship to a very sharp focus. I don't think there is any reason to despair yet. All relationships have issues. The new one will end up having those, too.
Have you discussed this with your respective partners?
Me: bi female in my twenties