Well, at least in the case of a battery, mileage will be very indicative of how many cycles the battery has been through.
But otherwise, yes, mileage alone is a terrible indicator of wear. Rubber seals wear out just sitting in a parking lot - in fact, it can wear out faster with lack of use (tires are a prime example…