If you are worried about the chlorine hurting your plants, they most likely will be fine without having to let the water sit. I've seen many examples of people using fresh tap water, including many grows myself, and the plants don't seem to notice. However, if you are worried about the chlorine possibly killing beneficial microbes you may have added, then def let it sit out.
I am forced to let mine sit out now because I use microlife in my water. For many grows I used it fresh without sitting, and I see no difference in my plants or yield/quality.