holmes drew conclusions from, as you accurately point out, the evidence in front of him. sometimes all the evidence wasn't in. he didn't guess at it. it was based on observations.
i'm not going back through the episodes to find examples but miller guesses quite often. if memory serves you can watch the 2nd or 3rd…