You answered your own question. Michael was missing exactly that by not being around them, and that made him a worse person. Being separated from each other made them all substantially worse. It's a surprisingly traditional message out of a show so irreverent.