That's the problem with setting up a force that seems unstoppable. It's almost never going to be as interesting or exciting when they actually defeat it. Like with the Shadows in Babylon 5. Hardhome is probably going to be the peak of the White Walker storyline in retrospect.