I have no idea if that's unreasonably far, or if it's a bad neighborhood or anything, but it was sort of an issue in the context of the show. Scarlett DID protest that he couldn't/shouldn't walk back from there. And we don't know if he actually walked, or if he just stewed for a while and then got a ride.