Even swingers have emotional connections to those they play with. What you're hinting at is hierarchical poly, meaning roles and importances are defined. Look up primaries and secondaries. Many poly people shy away from that, seeing it as controlling. It also often fails. You can rarely control depth of feeling.
I honestly think swinging suits your own needs.