I feel for you and him. It's too bad it has come down this road. Obviously you both care for each other and have a lot of respect for each other. Friends without benefits i suppose is where it is at like you said. For now meet others on their own turf physically and ask if non-physical interactions can occur in public or the home. Just don't flaunt it, treat your others like any other good friend when they come over.