I’m in a childless couple and get asked this all the time. Personally it doesn’t bother me too much - in most contexts it’s just small talk and people don’t even care how you respond. It’s not like they’re really asking you about intimate health details or personal morals.