Due to the appropriation by said people (whether zee nazis with the manji or southern racists with the confederate flag), those symbols were overwritten by more recent history, and as such should be treated appropriately. I can't imagine people being cool with the buddhist manji on license plates either.