I had to bail on my original Gmail address (from the original 1 GB invite days) because of this. Other people kept using it as their own address, and I got tired of getting stuff not meant for me (not spam but legit e-mails from other people, even work stuff).