Using your example, intent matters. It dictates the response of the person you elbow. Are they going to beat your face in, have you arrested for assault or understand it was an accident? How you behaved in that moment, what you intended makes a difference.
So people do give a shit about intent.