If you live in a decent house, yes.
However if you live in a (crap) apartment building where you have no control over the status of the pipes, it’s probably not a good idea to drink without testing it first.
Your city can have the fanciest and best water treatment available; it doesn’t mean shit if along the way to…