Oh Red... I feel for you. That seems to be a common train of thought among men: they usually just pick up and do whatever it is no matter what people will think or say.
That is something I have finally tapped into after years and years of holding my tongue and holding back so I don't hurt anybody. I got to a breaking point though. You will too.