Sure we would. Do you think all atheists are rapists and mass-murderers? If not, then why are there moral atheists? Justice comes from a sense of fairness, which in turn springs from human empathy. I’m pretty sure that do unto others as you would have them do unto you existed as a concept long before the Bible.