To me it sounds like you and the 3rd girlfriend are being used to boost his ego or whatever. It doesn't sound like you've known him very long and you might cut your losses before you get even more entrenched. It looks to me as thought you are trying to rationalize all this for his benefit. But it's your life...
Oh, and what Mono said about considering what he may be not telling you.