No, it works. Rather like how African-American and the n word are both ways of referring to a black person, the latter is highly derogatory, whereas the former is not. Just because they’re used to refer to the same thing, doesn’t mean one isn’t insulting.