Right, Carson is the only one who really singles out Molesley, the other servants seem to get along with him. Also, Molesley wasn't introduced as purely pathetic - he was a potential love interest for Anna, who treated his affection for her kindly. Edith's been kicked by her around by her family since day one.