I assume because Neal has never told anyone else about Mysterious Roosevelt Island Woman. She wouldn't necessarily have handed it over to anyone else, and even if she had that's clearly a part of Neal's life he likes to keep hidden away. If he thought he had a chance of getting away with it, he'd go himself.