Yes, it could very well be the water. At very least, you need to remove the Chlorine/Chloramine before using it to brew with.
If you're brewing with extract kits, you should be using distilled or RO water. Most super markets have RO dispensing machines and charge about 40 cents/gallon. Bring your own containers.