We have been only telling a select few people that understand our dynamic. We both feel like we are doing nothing wrong or illegal (here in Canada anyway), and if the conversation comes up, I think we would be happy to discuss it further, though not go into great detail.
The only big issue we have faced so far is that my ex-wife stumbled across my POF account (figured me out pretty quickly as of course she knew me well) and is now threatening to take away my son as I am a sexual deviant...I may I have to go to court at some point to set up some boundaries around her intruding into my private life. Anyone have experience around polyamory in the courts regarding children? Ugh.