Maybe being secondary just isn't for you? You can't really force a relationship any which way, after all. Why do you call yourself secondary?
Good luck with yours and your husband's adjusting to polyamory--I'm in the same boat since I got a boyfriend who's poly.
You're not being greedy, and the housing idea sounds lovely.