What do you want? Do you actually want more than one secondary type relationship or do you want a more full time arrangement with one person. There isn't a right or wrong answer to this but you shouldn't settle for less than (or different than) what you want.
Everything will be ok in the end. If it's not ok it's not the end.