As clever an idea that would be, they do not do that. The Pokemon you see can be seen by everyone around you, as well (unless you are using an incense, which you wouldn’t use if you were out of Pokeballs).

What you are experiencing is confirmation bias.