The fact that Clinton spoke to the former and not to the latter was indeed a problem. That's not the joke. That joke wouldn't have offended anyone (unless told crudely). The joke was "your gender identities are silly."