Or maybe the baby's father is the guy who kidnapped, raped and tortured Kitty.
And Sherlock's reaction was that he didn't know.