I've often wondered the same thing and we had a 2.5' deep stock tank and *well water* when my kids were little. They would be blue...

but insist they weren't cold!

have you filled it in the a.m. and let the sun warm it a bit before they get in? That can help.