I don’t think they cared. They eventually got diversity years later, but not when Colbert was there. John Oliver was pretending to be Steve Carrell, but he was probably chosen because he has a hit show on HBO and has been a guest on the Late Show multiple times.