Context. Jim is saying the fact that people will define his career partially by his academic intelligibility (Which lets face it, we will.) is a bad thing. He’s complaining that we didn’t appreciate what he’s done in his life.