Nvidia is taking a significant step toward addressing energy efficiency in data centers by unveiling a new generation of AI chips that require less cooling. This innovation could reduce the energy demand typically dedicated to keeping AI data centers from overheating.
AI data centers generate immense heat due to the high-performance computing equipment housed within them. To prevent hardware failures, data centers rely heavily on cooling systems, which require substantial energy. "Typically, air-cooled data centers require about 30 to 35 percent of the electrical energy that’s coming into the data center for cooling - just for cooling, not for computation", explained Vinod Narayanan, director of the Western Cooling Efficiency Center at the University of California, Davis.
Nvidia CEO Jensen Huang revealed details about the company’s latest chips earlier this week at the Consumer Electronics Show (CES) in Las Vegas. The new chips reportedly eliminate the need for traditional water chillers in data centers. "No water chillers are necessary for data centers", Huang said. "We’re basically cooling this supercomputer with hot water. It is so incredibly efficient."
The technological advancements by Nvidia aim to address the challenges posed by heat management in AI data centers. Currently, water is often used as a cooling alternative to air, but this method typically requires additional energy to chill the water. Nvidia’s new chips operate efficiently enough to be cooled by hot water, which could significantly reduce both water and energy consumption.
Chips must be kept below a critical temperature threshold of 175 degrees Fahrenheit (70–80 degrees Celsius) to maintain functionality, according to Narayanan. Nvidia’s innovation ensures that the chips remain operational without the need for energy-intensive cooling systems.
Huang's announcement had an immediate ripple effect on financial markets, as shares in HVAC (heating, ventilation, and air conditioning) companies dropped following the news. Despite the shift, some experts believe HVAC companies won’t be phased out entirely in the near term. "I think it does kind of just more explicitly draw out that the data center infrastructure is changing, and maybe those water chillers won’t have as big of a role over time in the data center than maybe they have now", said Timothy Wojs, senior research analyst at Baird.
Beyond financial implications, Nvidia’s innovation has the potential to yield long-term environmental benefits. Chips that require less cooling help reduce energy consumption, which indirectly cuts carbon emissions, explained Shaolei Ren, a professor of electrical and computer engineering at the University of California, Riverside. "The most immediate impact is reducing the energy, which indirectly reduces the carbon emission", Ren said. Additionally, new advancements could help reduce water usage in certain scenarios, as the chips may be cooled using ambient temperatures.
The move toward energy-efficient designs marks an important shift in how AI data centers are constructed. Ren noted that many of the data centers currently being planned are expected to consume less energy than their predecessors, a promising development for both the technology sector and the environment.
