No, it's a misconception, not a fallacy. And I'm well aware of schools of Buddhism who interpret "materialism" as being emotionally attached to wealth and not the accumulation of wealth. Not to mention that people who follow religions to the letter is fairly rare, which would undoubtedly apply to Buddhists as well.