Late to chime in here, but it really depends on the seat and the person.
If it’s a heavily-bolstered sport seat, it gets a little stuffy and warm back there. I actually tend to get a sweaty back if I drive for long enough. There’s cloth seats in both of my cars. Leather is definitely a lot worse though.