NOw that you mention it, I suspect there are some folk who identify as poly who are uncomfortable with queer folk. I say that thinking about the Alt Lifestyles forum on OKC, where many of the people who report being poly are actually swingers--and I remember some of them expressing distaste for queer folk.
So I suspect many of those being reported as poly and uncomfortable are actually swingers and uncomfortable. It appears from here that some swingers are trying to ride their wagons in the poly wagon train to gain some measure of respectability (odd notion, that). Or they simply equate all nonmonogamy and are incapable of understanding the distinctions.