i'm wondering if you have met this guy. Often a lot of fear diminishes when people meet each other. It often turns out they aren't the crazed lunatic that are thought of in our heads... even if you meet on line and talk that would help. Chances are you have some stuff in common, at least your fears, apprehensions and jealousy perhaps?
This site has tons of great advice and stories of others that are similar to you. I suggest doing a search in the tags or otherwise to see if you can find some support... this site for me has been a great mentor too.