Nah. My wife's sister was previously in a vee relationship and her daughter (wife's niece) grew up with the former step-father and step-mother. No conflicts from there. We don't have much contact with the rest of her relatives and those that might object are those we try to have the least contact with.
As for my family, they had to deal with me having an open marriage during my first marriage, a long, long time ago. It's not been mentioned in ages, so I've no idea what they think about it these days.