Yeah that's what I meant by " He waited until jon's herd had thinned."

Why is he late??? Geez. It's kind of obvious. Because Baelish wants Jon Snow and Winterfell to be beholden to him and his puppet knights of the Aerie. He waited until jon's herd had thinned. The saviors came right on time as far as Baelish is concerned.