It's possible that they had long assumed Stan's brother was dead, and simply didn't talk much about it with the kids. I wouldn't rule out that (let's call him this for the sake of argument) Stanley is actually the twins' real grandfather, previously thought dead.

Yeah, with everything else going on in the episode it's easy to miss, but that branch only misses stabbing Agent Trigger through the throat by an inch or so.