Wait a minute -- I'm confused.
Are you guys going to hold off on pursuing poly until after you've worked on your relationship with each other some more, or not?
You both seem really impatient. I think you would benefit from stepping back and building your foundation to be stronger, develop better communication and deepen your intimacy with each other. I see that you both have issues with anger, too. Therapy or counseling would be the next step I see for you two, seriously.
Poly can wait, sheesh! Reconnect with each other before connecting with anyone else. Why in such a hurry?