Well keep your attention centered on what you can control; you can decide your own actions, but he in turn decides his. You can always ask him to talk about it. It sounds to me like he has some issues he needs to sort out in his own mind. The main problem here is, perhaps, that he doesn't "feel right" about the whole poly situation.
Love means never having to say, "Put down that meat cleaver!"