My relationship has ended...
I contacted them both and asked that we discuss the rules and ways that they can work for everyone so that the needs of all involved are taken into consideration.
At that point the relationship was ended by the wife and all contact in the future is out of the question.
Makes me very sad but that is the way it is.
but I thank you for your thoughtful advise.