The only part of the patent actually mentioning phone calls assumes that the caller is using the now-defunct "1-800-GOOG-411" service; Essentially, you've called Google for information, and are talking to a computer. You aren't discussing private matters with the poolboy.