Communicate, communicate, communicate...tread very carefully. It may be that this opens up the conversation, but it's not the right time to bring it into reality. The fact that you slept with the friend before establishing the rules doesn't sit right with me....but I'm glad the your husband seemed to be oaky with it. he may just be going along.
Get things on good terms with your husband and then proceed carefully.