Did you also ask him to refrain from talking to anybody aside from you? That's the only way that would have been consistent--if you asked him not to speak to people just because you thought he should do nothing except spectate at your experience. As it was, you simply asked him to not speak to some people, though that may have been only because there weren't many people in close proximity with whom he'd strike up conversation.
Get the idea that I think your request was unreasonable? You should. If he were to be texting while engaged in conversation with you, he would be out of line. When he's not actively engaged in a discussion with you and simply waiting, with whom he speaks and how he goes about doing it isn't something you get to decide.
And it was a big "fuck you" message to him. Fuck his experience--he can only think about yours. Fuck his way of managing his stress--he can only do what you want him to. Fuck him being his own person--he's supposed to be your pet/puppet and only do what you want.
When speaking of various forms of non-monogamy...it ain't poly if you're just fucking around.
While polyamory, open relationships, and swinging are all distinctly different approaches to non-monogamy, they are not mutually exlusive. Folks can, and some do, engage in more than one of them at a time--and it's all good.