Yes, I think it's the same with BDSM for instance where a lot of people think "there is no way this person is actually fine with this! They must have been coerced and/or brainwashed into thinking they're ok with it!"
In the end, it's really about people being unable to conceive that others may think or work differently. I'm not into being a 24/7 sub but I realise that some people are. When it's consensual it's fine. When it's forced it's horrible. Same with a lot of things, including sex itself, really.