As you stated, it feels as if some asexuals were under the impression that non-asexuals are just horny people having sex 24/7, and therefore believe their lack of wanting to bang everything all the time means that puts them outside the norm, when that is the norm.