It’s possible the old man Kellogg was referring to was the previous director.

If you have been banished from the Institute, your settlement can be infiltrated by synth settlers and eventually, they will turn on your settlements and attack other settlers. Other institute synths will show up and attack as well. It doesn’t happen often though.