The White Walkers without the wights are like six dudes (well, not six, but few enough that 10,000 soldiers and wildlings armed with dragonglass oughtta be able to take them). Also if dragons make dragonglass, and dragonglass kills white walkers, makes sense that dragons kill white walkers.