Upon first viewing, I thought it was definitely Pitt imagining a confrontation with Lee, which would result in him getting kicked off the set, which led to him ruefully saying, “that’s about right”, owning that he’d deserve to be fired. But that doesn’t wash with the actual movie: