Your feelings don't seem irrational at all. And NYCindie's idea of a cuddle pile would be so awesome!
That connection after sex is something I crave and felt missing from our swinger experiences. I would have felt the same way. We all have our different needs, maybe no one felt comfortable doing it and all wanted to? You never know until you talk about it. You wanted some of the afterglow, the intimate time after. There's not a thing wrong with that or with speaking up about wanting it.
Maybe discuss it at a time when you aren't all in bed and things are less fueled with hormones?
Love laughs at locksmiths. ~ Proverb