This actually came up in a city I lived in when a temple displayed the traditional swastika, so it was relatively top of mind, even though it was a while back. I don’t think it affects their view of the symbol so much as it alarms people unfamiliar with any other context.