Yeah, some games are pretty crafty in the way they fool us.

A friend of mine pointed out another part of it the other day, and I think it plays a role too: slight lack of precision. Games like Flappy Bird, Angry Birds, and so on make it hard to be precise, which is part of that challenge—but it's the kind of challenge that makes you think "oh man, I was so close that time, I…