Yes, your husband (and you) did open a Pandora's Box. But he has a misunderstanding about your sexual feelings. He ASSumed you could have sex without emotions. Casual sex, with someone's body (or voice) merely, no emotions attached.
Maybe some people can do sex like this, with no emotions, like robots. Many of us can't.
Love withers under constraint; its very essence is liberty. It is compatible neither with envy, jealousy or fear. It is there most pure, perfect and unlimited when its votaries live in confidence, equality and unreserve. -- Shelley
There's no lying in polyamory!
I'm a 58 year old woman with 2 partners:
miss pixi, my live-in gf, 36 (together since Jan '09)
Ginger, bf, 61, married, lives nearby (together since Jan '12)