I've had no female partners match my sex drive--not a single one. Even now, when my testosterone levels have dropped significantly in the wake of a medical treatment, my sex drive is still higher than that of the women around me.
The only times I've turned down a woman with whom I've been involved have been when I was approached shortly after she pissed me off about something and I was in no mood for interaction. That's happened perhaps three times in my adult life.
When speaking of various forms of non-monogamy...it ain't poly if you're just fucking around.
While polyamory, open relationships, and swinging are all distinctly different approaches to non-monogamy, they are not mutually exlusive. Folks can, and some do, engage in more than one of them at a time--and it's all good.