How could he protect his family when he's all the way up north at the Wall?