Only a layman here, but as I understood it, the differences between the brains of the two genders are always less than the differences across a single gender. That is, there is substantially more variation between all men, or all women, than between the averaged scores of the two groups.