This is all still new to both of them so I'm sure things are all kinds of unstable. I think it's great that you're taking his feelings into consideration. It's what any good gf would do, but talking about it may be what he needs. Especially with his gf.
In case you couldn't tell I'm an avid fan of communication.
Again, I wish you the best of luck.