Don’t feel too bad about it, it’s a very common misconception. I didn’t know either until it was pointed out to me by a Japanese friend. See also the part about many westerners erroneously thinking that characters in Japanese animation look ‘western’ because that’s what we expect to see. Our minds fill in missing…