Nvidia says it can cut data center water use. The AI boom has a bigger problem

Data centers, in case you haven’t heard, have a water problem. As AI companies race to build the massive computing facilities needed to train and run powerful models, the water required to cool those facilities has become a flashpoint for communities, utilities, and environmental critics. According to reporting by the Environmental and Energy Study Institute (EESI), a large data center can use up to 5 million gallons of water per day, roughly as much as a town with tens of thousands of residents. That concern has become part of a broader backlash over artificial intelligence infrastructure, including rising electricity demand, pressure on local grids, and the possibility that nearby ratepayers could end up shouldering some of the cost. That is why Nvidia’s announcement last week landed as a welcome, if limited, answer to one of the AI boom’s more stubborn infrastructure questions: Can the industry keep building bigger and more powerful data centers without consuming vast amounts of water to cool them? The company says its newest AI servers, built around its Vera Rubin platform (named for the pioneering astronomer), can sharply reduce on-site water use by letting their cooling systems run hotter than before. The servers are cooled by a circulating fluid that enters the system at 45 degrees Celsius, or roughly 113 degrees Fahrenheit, hotter than a typical hot tub. The coolant can rise to 55 degrees Celsius, or about 131 degrees Fahrenheit, before being cooled back down outdoors by dry coolers, which work like large radiator coils that transfer heat outside the data center. Then the same fluid circulates back past the chips in a closed loop. The fluid, a mixture of water and propylene glycol, runs through structures called cooling plates that sit atop the computing chips, including Nvidia’s Rubin GPUs and associated Vera CPUs, to absorb their excess heat. The significance of the design is not simply that Nvidia is using liquid cooling. It is that the servers and coolin