Safe to drink and tastes good are two different things. There are, as alcaponejunior advised, compounds in safe to drink water than are not suitable for making beer. As noted, chloramines will react with normal phenols created by yeast and create chlorophenols which taste medicinal and band-aid like. Most folks have a really low threshold for those so it is noticeable in small quantities.
Good practice is to use, at least, a simple, inexpensive activated charcoal filter. I use a Culligan D600 housing and a D40a filter ($26 on Amazon). There are less expensive filters but I like to keep kegs of carbonated water and rootbeer and just like the taste better from this filter. Total cost was $55 and I have plenty of great tasting water for drinking and brewing.
I also use some potassium metabisulfate (Campden tablets but in bulk powder from from the wine section of the homebrew shop). I measure 1 gram then quarter it and use the 1/4 gram (One Campden tablet is .22 gram) for brewing 5.5 gallons. Of the quarter gram, half goes into the strike water and half into the sparge water. This is mostly insurance but potassium of a yeast nutrient too.