This is so true for me as well. It's essential for me to love the smell of my partner, a physical relationship is impossible otherwise. It was a strange concept for Lin (my boyfriend) at first, but after I told him why it is so essential for me, he noticed it as well. We got a LDR at the moment and it's always the first few moments, the first hugs and kisses that we use to literally inhale each other.
I know the smell of my family (mother, father, siblings), partners and friends. I can tell them apart by it and react negatively towards people I can't stand to smell
We got a proverb in German: If you are unable to bear/stand someone, we say you can't 'smell' him.