I kind of presumed that any Walt cameo would be later in the timeline when they were into the time where Jimmy was Saul and after he had already had his intro scene with Walt and Jesse. If they cross over into that time frame at all, it makes sense.
If they have a cameo earlier in the timeline, I can see them passing…