King Robert said it would have to be an uncommon girl to make Ned Stark forget his honor. I say it's true for his children as well. I'm hoping they reveal the nurse to be of a noble house though, because I don't know how Rob's bannermen would ever let a random camp follower be alone with him.