Understanding Liquid Cooling: A Critical Component in AI Advancements
In an exclusive interview, Rick Kirchner, Vice President of Engineering at Colder Products Company (CPC), sheds light on the increasing necessity of liquid cooling systems in managing the thermal energy produced by high-density GPUs in AI and high-performance computing architectures. His insights highlight the advancements and challenges in this evolving field.
Boston, October 2023—In a detailed discussion with Kevin Jackson for the Executive Debrief series, Rick Kirchner, Vice President of Engineering at Colder Products Company (CPC), explored the indispensability of liquid cooling systems in modern AI and high-performance computing. As GPUs become denser and more complex, traditional cooling methods like air cooling are no longer sufficient to manage the thermal energy they produce.
The Shift to Liquid Cooling:
Rick Kirchner explained that the dramatic rise in power density of GPUs necessitates a shift to liquid cooling systems. The thermal energy generated by these chips is now so significant that air cooling cannot effectively dissipate the heat. "As computing architectures evolve, liquid cooling has transitioned from being an advantage to a necessity," stated Kirchner. This shift is evident in companies like Nvidia mandating liquid cooling for their latest GPUs to ensure optimal performance.
CPC's Technical Advancements:
CPC has been at the forefront of developing advanced liquid cooling systems, specifically their Everest Quick Disconnect couplings. These technologies are designed to protect expensive AI and computing equipment from leaks, particularly during maintenance. Kirchner highlighted that these couplings allow for 'hot swaps,' enabling the disconnection of components without the risk of fluid leaks. This dual-valve technology ensures that no liquid drips or leaks during maintenance, enhancing the reliability and safety of these systems.
Collaboration and Innovation:
CPC’s extensive collaboration with Nvidia exemplifies the critical role of liquid cooling in cutting-edge AI technology. Kirchner elaborated on their partnership, detailing frequent engagements and collaborative efforts in application engineering and technology development. This relationship extends to sub-suppliers and broader ecosystems, including giants like Amazon and technology integrators such as Supermicro.
Kirchner expressed his enthusiasm for their work with Hewlett Packard Enterprise (HPE). This collaboration dates back to CPC's involvement with Cray, prior to its acquisition by HPE. The partnership has led to significant advancements, including contributions to the Aurora supercomputer at Argonne National Laboratory. "Our close proximity allowed us to work intimately with Cray, enhancing our products and learning from each other," noted Kirchner.
Educational Initiatives:
CPC also prioritises technical education on topics like ambient conditions and material compatibility in liquid cooling systems. Kirchner emphasised the importance of this education in preventing common pitfalls such as corrosion and material incompatibility. Sharing this knowledge helps uplift the entire industry, fostering the success of both their customers and the broader community.
Looking Ahead: Future of Liquid Cooling:
Kirchner is optimistic about the future, predicting further advancements in cooling technologies. He anticipates the rise of refrigerant-style systems, which use two-phase cooling processes to manage even higher power densities. This involves the coolant transitioning from liquid to vapor and back, similar to air conditioning systems. Such technologies are already under research and could become standard as performance demands increase.
Conclusion:
Through CPC’s innovations and collaborations, liquid cooling systems are poised to meet the growing demands of AI and high-performance computing. Rick Kirchner’s interview offers a comprehensive look at the technological strides being made and sets the stage for exciting future developments in this critical field.
Source: Noah Wire Services