I think it’s because there are social and political issues around marginalization and stigma that deserved to be worked through. Like if someone said they “don’t date black people”—there’s a meaningful difference between that statement and “I don’t date men with facial hair”.