Actually, they go back in time to the 1850s, sort of like a reverse Blackadder, only they maintain story continuity. Lord Grantham debates the Crimean War with Branson, Dickens is derided as a hack, and the faker from season two comes back and Edith marries him anyway.