I go with what RP said big time. I Really, really hate hypocrites...and he should have seen this day coming when he was walking the red light district. I Don't remember him saying that because of his experience and your reaction that he wanted to take this off the table at the time.
Sorry honey can't have it both ways. Time to do the work, read the threads, go to therapy...whatever it takes.