I’m guessing that the magic of the walls is similar to the magic used to protect the raven. Bran going past the wall may dispel it since he was touched by the night king is my guess.