Following that line of logic, businesses could refuse to serve black people because they don't like black people. That's not permissible under law. If your business serves the public, it serves the PUBLIC, and you don't get to pick and choose. But, yes, in the end it's their loss.