A colloquialism is like “the middle of nowhere”, “running around lik headless chickens”, or, in this case, “no man’s land” - which actually comes from the Wars, referring to the area between the two enemy armies’ land. It’s not sexist. It’s common sense.