You’re forgetting cross-match-ups in transition. Barnes is one of the best hustle/speed players in the league (according to tracking stats last year). If he’s guarding Duncan, Duncan will most certainly lose every foot-race back to the Spurs’ basket.