Except that people who support trans people in sports aren’t saying “gender doesn’t matter”. We’re mostly saying “trans women who have been on estrogen and anti-androgens for a few years have no notable advantage over cis women”, which is very different from the straw man you’ve constructed here.