Sure, but that was the whole point of the last season finale…. Not only does he know he forgot SOMETHING, he even knows it is something crucially important to his life, because of the holes the memories left all over his own timeline. I loved how Bill's reminder hit him like a ton of bricks in that scene.