To move to Canada you would have to have a sponsor either through a job or personal sponsor who would be willing to support you for X-amount of time if you aren't working. This would require a visa or immigration papers AND passports for everyone. If any of you has a record, even a minor conviction, this could definitely affect whether that person would even be allowed across the border.
Toronto is poly, sex & kink positive as well, lol.
Lots of luck finding a place to live that's warmer AND sunnier, lol.