This is harmless. If you want to drink the water, let it stand for a moment in a carafe or in an open bottle, or add a few drops of lemon juice. The chlorine will evaporate.
Disinfection of the tap water network is essential to prevent bacterial contamination during transport. 1 litre of tap water may contain 0.25 mg of chlorine, a small amount that is not harmful to health.