If that's what you were doing, by all means, please continue. Most time when someone says, "It was a Jew" and is trying to place blame, it's considered derogatory, even if buffered within a joke, since Jews have a history of being scapegoats. Yom Tov! (Have a nice day! - in Hebrew)