Secret or seperate?
I know my partners wouldn't dream of getting involved with each other. I have two totally seperate relationships in that respect. But they do have a building friendship and I do talk to them about the other one in general conversation.
I think you need to figure out exactly what is bothering you about this woman and her relationship with your partner, and discuss it with them openly if that feels appropriate. (That's my advice anyway!)