Ahhhh, back to thermo.

Yes Keiva, you are almost exactly right. The density of water increases from 0-4 degrees C, or 32-39 degrees F then falls as the temperature rises.

At 0 degrees C water weighs 62.4199 #/ft3.
At 4 degrees C it is up to 62.4283 #/ft3.
At 100 degrees C water weighs only 59.8307 #/ft3.