Yeah, but he was Joffreys sworn sword. His whole job was to protect Joffrey from “threats”, and Joffrey said the butchers boy attacked him. Now we know Joffrey was lying, but as The Hound states to Arya and Beric and the others, "its not my place to question Princes"