I decided to not care so much. When I had to switch from a jeans-and-t-shirts workplace to business casual, I plunked down money for two pairs of trousers and six lightweight sweaters with matching/coordinating camisoles and I wear the ever-loving crap out of them.