You know, it works because Banner was always angry. He just suppressed it all his life which is what allowed The Hulk to come into being. I rationalized that he actually keeps it at a low, controllable boil so nothing can suddenly overwhelm him to the breaking point.