The books make a big deal about how that it’s obvious that Olaf is terrible, except to adults who have no ability to see right through him. I don’t know if you can make Olaf be a normal, serious man. The illustrations in the book make him appear visibly sinister.