I agree with MBG.
Do you have people you can talk to ? since you are worried your marriage might end over this, this leads me to believe you are experiencing some type of hugely, stressful upheaval.
Was his reaction quite strong, or do you feel trapped with nobody to vent to ?
Many times things feel quite desperate in our own heads, when we dont have objective people to vent to.