Punishment usually is imposed by some authority (formal or informal), isn’t it? In normal usage, I would never say that I was going to punish a peer, fellow citizen, etc. I could punish my child, or my student, my employee, or whatever, but there’s always a power dynamic.