Hang in there Whimsey. These things can work out well. We've just been hanging out on the couch watching a movie (way different time zone) and I could barely contain the love I feel for Z. And yet just over two years ago I was exactly where you are, although not handling it nearly so well.
The coming together after the time away can be wonderful if you let it.