Look at it this way. Social media is basically a multiplier.
As you say, he said what he said. Problem is, a whole lot of people heard him say it. Way more than he was expecting. And then, when informed of this, he wasn’t smart enough to realize this (or wasn’t smart enough to realize his views are generally seen as…