If he were Benjen, his nephew Brandon Stark, who only last saw him a relatively short time before he went off ranging, would recognise him. If a scarf is supposed to render his entire appearance unrecognisable then that's almost as daft as Superman's glasses.
That's just stretching the suspension of disbelief a little…