They said in the premier that Willoughby had only a handful of able-bodied men, and about half-a-dozen guns. Given that they'd already lost two of those men (and their guns) in episodes 2 and 3, I'm willing to accept that the town is severely understaffed.