If you live in such a crappy neighborhood, I suggest you keep the door locked at all times, not just when you go to bed, and he should have his own key!
But that's another issue. I think most here would agree that keeping you abreast of his whereabouts and expected time home is a simple matter of consideration for the one you love and live with. If I were you, I'd also request that you meet his date.
Independent solo polyamorist seeking lover-friends willing to invest in friendship, companionship, and love, but without a need for partnership.
Never confuse commitment with exclusivity, love with ownership, nor sex with intimacy!
For me, it is far better to grasp the Universe as it really is than to persist in delusion, however satisfying and reassuring.
~ Carl Sagan