As much as I understand where you’re coming, I’ll say that the reason the word ‘pride’ is used is because, for so often, those indicators were emphasized as marks of ‘shame’ or ‘otherness’. Something to be ashamed of or something to feel made you a lesser, either explicitly or implicitly.