I agree with KyleKat. You should talk to him about all aspects of the poly life he wants to lead. You shouldn't be "forced" into anything, and he should be patient with you and your getting used to the idea. If your number one as he says then he should be slowing down until you are comfortable with the situation.
What did you mean by "finding myself crying uncontrolably for my lost past?"