Like km said, I don't think it should matter whether you are poly or swingers - you need to work out what you want and to heck with anyone who tries to tell you you shouldn't be that way!
The usual simple definition is "If it's primarily about the sex, with maybe some love there, then it's more swinging. If it's primarily love, with some sex in the mix, then it's more polyamory".
Does that make sense?
Also, there's nothing stopping one from evolving into the other! Since there's no certification board, you won't need to worry about losing your license or anything!
Welcome to the forum!