Well, if the fantasy works for you..........try it out. It may be that the reality doesn't work out, if it does though, great. You wont know till you try.
I agree with your wife, it really doesn't matter about why you like things. In fact, talking, thinking or analysing to much can really take the pleasure out of it. It really pisses me off when my girl turns all shrink on me.