I make it a rule of thumb that I just let everyone know I'm in a polyamorous relationship (which immediately gets a "HUH?" response). Then I elaborate about what it means. That way anyone who is potentially interested-already knows about my situation.
I am always very up front with everyone that I have a husband and almost everyone that I have a boyfriend.
"Love As Thou Wilt"