The dividing line is that people in public are "fair game." It's kind of perverse to take pictures of celebrities buying groceries or whatever, but it's not really a privacy violation. This is more like breaking into someone's house to steal their photo album.