It is a valid relationship structure for one polyamorous person to seek a closed relationship with two monogamous people. Whether they be men or women.
Is it inherently misogynistic? No. I dont think so. Theoretically. As long as everyone consents to the agreement freely. In practice, I think misogyny or it's anti-male counterpart is more likely to be prevalent. This has historically been true when societal pressures subtlety (or not so subtlety) coerce the monogamous partner to remain monogamous.
Sucessful polyamory requires great introspection.
The question you should ask is, if your needs are being met, why would you need to control the actions of another?
Me: 48 - Married, straight, male
Shiela: My wife.
Suzanne: My FWB
Adam: Shiela's LDR