It’s a special case because it’s a recent rule. Until 1992 it was perfectly legal for keepers to pick up a back pass from a teammate, but teams started to use it so much for time wasting that a specialized rule had to be created to address it. I guess treating it like an ordinary handball was seen as too draconian.