Too many? Hmm. I'm sure my SO thought at some point that the amount of partners I've had is too many but obviously it didn't mean too much since we're still together with a child, lol. I didn't care what his number was; that isn't an indicator of anything weird to me.
It sure does still matter, depending on the person. I think by now after getting to know me SO knows that we view sex differently and that's okay. It is what it is. He has to love said partner, I don't.