I think at this point, time management IS the biggest issue... but again, I try and keep in mind that I decided this when I knew the situation aforehand. He actually lives with his other g/f, and I can't exactly say that I'm in a good position having him over. (Be it explaining the situation or otherwise).
I've tried to take all of it in stride that, I'm the person that decided to try this, knowing full-well how I'm used to going about things. So I very well expected to have difficulty. But I still feel guilt, knowing I'm not in the right mindset.