Goes both ways in my family. I don't understand Mandarin or Cantonese as well as they do, so they may use that to talk about my two siblings and I at the dinner table. Or other relatives when they're around. On the other hand, nobody but we three understand Spanish, which we're all at least conversational in.