Others have answered your question, but I'll add in that there's an element of distance involved, too. If you film someone from 100 feet, you're fine. If you walk up to someone and stick a camera in their face, you're going to need them to sign a release.