DO all of your other friends dislike him? This guy may be trouble... I've been in the situation before (not with relationships but with incredibly close friendships) where nobody seemed to like my two closest friends and they turned out to be emotionally manipulating and abusing me and I didn't realise it at all. My family and close friends saw it at once and did not like them at all.
Or your primary could be jealous.