Thanks for the replies!
I think what confuses me is that I've had females tell me that I give off a lot of feminine energy at times (which, to some, seem to be a turn off). I often saw "aweeeee!" and get emotional like females do over stuff. I know this is playing into a gender stereotype, but that's exactly it... I don't seem to always fit the male stereotype in terms of what I want and how I want to act.