Polyamory is all about the love, dahling. Love and loving, caring actions, with complete honesty and consent. To many people, having polyamorous relationships does not necessarily mean they all involve sex. Folks can have loving, non-sexual partners as part of their polyamorous tangle. But when the relationships are sexual, it doesn't mean all people in a poly tangle are involved with each other nor have sex together. A poly person can maintain separation between all their relationships. Being or practicing poly just means you have multiple, ongoing, loving, committed relationships, in whatever form they take.
Cuckolding and hotwifery is all about the sex, dahling. They are sexual fetishes.