Counter attacks are apparently what is expected to beat him. I did manage to finish him after a LOOOOOOOOONG fight where I would rarely chip away at his health. So, possible without counter attacking but a pretty major pain in the ass to do so. No really hard, just super annoying.