Peter died. He came through the timeline at the beginning of season 4 through  Olivia and Walter's love.