My question is, do you want a female-monogamous relationship with her?
As for impact on the husbands, other than watching you girls with other women, I'm not sure how it will impact them.
Me: 48 - Married, straight, male
Shiela: My wife.
Suzanne: My FWB
Adam: Shiela's LDR