Crawford offers to leave Will alone in the next Tooth Fairy kill site in the latter part of Red Dragon. It's quoted almost verbatim in the Pilot. The idea that Will makes intuitive leaps that can only be backed up by evidence later is also straight from the book. So the mind palace bits don't seem too far fetched.