Biggest difference is one doesn't need the other. I, and likely a lot of people, am not a voyeur, yet I derive pleasure in knowing my wife is with someone.
My wife is a voyeur and has compersion, she really enjoys watching me with other women and feels absolute joy. To date, she has not allowed me to be with a woman without her at least watching.
As with anything there is overlap...but they are seperate