I think a lot of the moral criticisms are quite shallow, as well. But the right response to this is to offer a rebuttal to the critique. Don't just say "You shouldn't critique this on a moral basis." Tell them why the critique is wrong, don't just dismiss it from the equation entirely.