It most certainly IS the morphene man that makes it gendered. Inasmuch as “man” has gendering. You can’t simply handwave that away and argue usage, because if you do you’re saying that we could have kept fireman and just through “usage” removed its gendered aspect—and that’s absurd.