That's a good point. I reckon most Westerosians would just react to Bran in a "WTF, quit being weird" way like Sansa did.

Bran should now know all of it, though, and wouldn't need Sam's knowledge any longer.

How do you do, fellow kid?

I also thought it was the house on Paper Street.