Well - one of the most common philosophies associated with "swinging" is the no emotional connection rule. But I will tell you that for many that doesn't work - because it's against our nature. We're designed to connect with people on some other level than physical. That's why there are so many horror stories associated with 'swinging'. Some mange (with difficulty) to succeed, most don't (if they were all honest about it).
So it's good you are thinking this through first !
My suggestion - just go forward carefully and be aware things can change. Focus on the sexual aspect if you want but make no assumptions. On the other hand, making it a love quest often fails also - so don't go into it with some big agenda. Just treat people as people and let things develop as they will.