My 11th grade World Religions teacher ( yeah, the irony...)...said to me ;
' People can only get to you, if you let them. There has to be fear in your heart, that your critics are right. Eradicate the problem within yourself, and you in turn eliminate the affect negative-people have on you.'
So,..like most things, you can only control yourself.