Perhaps you could take a break from seeing your OSO and see how you do with just your wife seeing her OSO. There's no rule that you have to be with another couple equally. Just because you want to stop doesn't mean everyone has to, does it? You can both have separate relationships. Lastly, moving way shouldn't even be an option. Relationships end sometimes. Are you really super embarrassed about it, and that's why you would move?