I never just *realized it*
I always knew, but honestly, the social stigma in my former location would not let it permeate.
My wife always chalked it up to bringing other people into our lives was too complicating. Though I think both of us always were interested.
What we've realized now that we're in a more comfortable environment, is that the complication may in fact be worth it.