See, that's why this structure is really amazing. For episode after episode you're wondering why GOB just sort of sits there and says nothing, and then when you see it from his perspective that running joke sort of makes it clear that something utterly terrible has just happened to him right before every scene.