Because then I have to worry about carrying a bag around rather than just using the pants/shorts that I’m already wearing.

Cargo Shorts or GTFO. I'm too old to worry about impressing anyone.