I noticed the switching back thing too, but the episode in question is also a "Thanksgiving" episode, and I thought we were in the middle of the summer in the Hamptons? That made me think it was another Revenge Flashback (or maybe flashforward?) Episode.