I feel similarly. I was in an awkward conversation with a friend once and just played my DS (or PSP, don't remember for sure) and she pointed it out and that it was offensive to her. I've been very conscious of not doing that to people anymore, but still like occupying my mind while I'm uncomfortable.