Reducing data centre power costs by up to 40 per cent

Supermicro continues to expand its data centre offerings with liquid cooled NVIDIA HGX H100 rack scale solutions.

Advanced liquid cooling technologies entirely from Supermicro reduce the lead time for a complete installation, increase performance, and result in lower operating expenses while significantly reducing the PUE of data centres. Savings for a data centre are estimated to be 40% for power when using Supermicro liquid cooling solutions compared to an air-cooled data centre. In addition, up to 86% reduction in direct cooling costs compared to existing data centres may be realised.

 

"Supermicro continues to lead the industry supporting the demanding needs of AI workloads and modern data centres worldwide," said Charles Liang, president, and CEO of Supermicro. "Our innovative GPU servers that use our liquid cooling technology significantly lower the power requirements of data centres. With the amount of power required to enable today's rapidly evolving large scale AI models, optimising TCO and the Total Cost to Environment (TCE) is crucial to data centre operators. We have proven expertise in designing and building entire racks of high-performance servers. These GPU systems are designed from the ground up for rack scale integration with liquid cooling to provide superior performance, efficiency, and ease of deployments, allowing us to meet our customers' requirements with a short lead time."

 

AI-optimised racks with the latest Supermicro product families, including the Intel and AMD server product lines, can be quickly delivered from standard engineering templates or easily customised based on the user's unique requirements. Supermicro continues to offer the industry's broadest product line with the highest-performing servers and storage systems to tackle complex compute-intensive projects. Rack scale integrated solutions give customers the confidence and ability to plug the racks in, connect to the network and become more productive sooner than managing the technology themselves.

 

The top-of-the-line liquid cooled GPU server contains dual Intel or AMD CPUs and eight or four interconnected NVIDIA HGX H100 Tensor Core GPUs. Using liquid cooling reduces the power consumption of data centres by up to 40%, resulting in lower operating costs. In addition, both systems significantly surpass the previous generation of NVIDIA HGX GPU equipped systems, providing up to 30x performance and efficiency in today's large transformer models with faster GPU-GPU interconnect speed and PCIe 5.0 based networking and storage.

 

Supermicro's liquid cooling rack level solution includes a Coolant Distribution Unit (CDU) that provides up to 80kW of direct-to-chip (D2C) cooling for today's highest TDP CPUs and GPUs for a wide range of Supermicro servers. The redundant and hot-swappable power supply and liquid cooling pumps ensure that the servers will be continuously cooled, even with a power supply or pump failure. The leak-proof connectors give customers the added confidence of uninterrupted liquid cooling for all systems.

 

Rack scale design and integration has become a critical service for systems suppliers. As AI and HPC have become an increasingly critical technology within organisations, configurations from the server level to the entire data centre must be optimised and configured for maximum performance. The Supermicro system and rack scale experts work closely with customers to explore the requirements and have the knowledge and manufacturing abilities to deliver significant numbers of racks to customers worldwide.

Initial 60MW phase due second half 2025, to provide heat and hot water to the surrounding community.
Deal to strengthen Vertiv’s capabilities to support deployment of AI at scale.
Infosys is working with Shell New Energies UK Ltd to accelerate adoption of immersion cooling services for data centres.
At the recent world Data Centre World Paris, Exagate attracted attention with a stand offering valuable additive solutions for data centers such as environmental monitoring, power distribution units, leak detection systems, and software, and shared with the world how advanced its technology is.
Intel’s next-generation AI accelerators will be supported by Vertiv™ liquid-cooled data center infrastructure solutions to help organisations accelerate AI adoption while achieving sustainability goals.
Intense, urgent demand for artificial intelligence (AI) capabilities – and the dueling pressure to reduce energy consumption, costs and greenhouse gas emissions – loom large over the data centre industry heading into 2024.
Major order for series production of energy-efficient cooling systems for high-performance servers.
The AI-based cooling system implemented in FR6 with energy intelligence startup etalytics had significant effects on the data center’s carbon footprint with an increase in energy efficiency by up to 9% of the data center infrastructure. Due to the promising results of the pilot project, the cooperation is being expanded as a first step across nearly all IBX data centers in Frankfurt.