Maybe I'm not reading this clearly..........
You are trying to say that unless you all live together there can't be any relationship or sex ? Is this correct ?
Seem like a control thing to me ?
Many people can't live together and get along properly. It's especially hard as the numbers grow from 2, to 3 to.......more. The more people the more difficult it is.
But that should have nothing to do with the relationships involved. Some relationships will just always thrive better when there's more space & privacy. It doesn't seem (if I read correctly) that it's your 'call' how the relationship flows just because you can't all exist under one roof.
Did I miss anything ?