There is a general distrust of the Time Lords, though, which would leave open some room for the later incarnations being unhappy about the actions of a "Second and a Half Doctor" (see my comment below) who was forced to do the Time Lords' dirty work after his trial. The involvement of the Time Lords might also help…