I agree that just facing your fears is gonna be what's best here. Good on you for working on it. Does it not help at all to think about the fact that the time you spend with your gf doesn't make you love your husband any less?
There are some resources here that may be of help to you: http://www.morethantwo.com/becomingsecure.html
Me, 30ish bi female, been doing solo poly for roughly 5 years. Gia, Clay, and Pike, my partners. Davis, ex/friend/"it's complicated." Eric, Gia's husband. Bee, Gia and Eric's toddler.