You’re comparing the time it took for Brienne and Sansa to travel to Castle Black on foot/horse to sailing speed? That seems odd considering land routes are rarely straight and frequently involve elevation changes.
According to Westeros.org, the Wall is 300 miles long, approximately. Using this measure, it’s…