It doesn't have to "track," for you… it has already been answered in interviews. I will take their word for it, although it is what I already speculated originally.

The person looking at Carol was prisoner "Andrew," who was sneaking around the prison after Rick left him for dead earlier. Of course he went on to cause all the chaos in episode 4… "Killer Within."