The “on” in “on purpose” means “according to”, the way that an action can be “on plan,” i.e., according to my purpose/plan. “On accident” doesn’t make sense because accidents aren’t intended, so an act cannot be “according to my intended accident.” Of course, some also have a strong bias towards “by accident” because…