I don't think you are in the minority at all. I have seen posts of this nature in this forum and personally know someone in the same boat.
Whether you can live with those restrictions on who you can love is totally up to you. Reading and soul-searching help.
Hinge of a V relationship with my husband (Thumper) and boyfriend (T-Rex). Also, mother of a 6 y/o girl by my husband.
My poly story begins here
. Now with new blogging