Data Center Cooling Solutions

Every cloud provider faces the same AI infrastructure challenge: chips need to be positioned close together to exchange data quickly, but they generate intense heat, creating unprecedented cooling demands. We needed a strategic solution that allowed us to use our existing air-cooled data centers to do liquid cooling without waiting for new construction. And it needed to be rapidly deployed so we could bring customers these powerful AI capabilities while we transition towards facility-level liquid cooling. Think of a home where only one sunny room needs AC, while the rest stays naturally cool – that’s what we wanted to achieve, allowing us to efficiently land both liquid and air-cooled racks in the same facilities with complete flexibility. The available options weren't great. Either we could wait to build specialized liquid-cooled facilities or adopt off-the-shelf solutions that didn't scale or meet our unique needs. Neither worked for our customers, so we did what we often do at Amazon… we invented our own solution. Our teams designed and delivered our In-Row Heat Exchanger (IRHX), which uses a direct-to-chip approach with a "cold plate" on the chips. The liquid runs through this sealed plate in a closed loop, continuously removing heat without increasing water use. This enables us to support traditional workloads and demanding AI applications in the same facilities. By 2026, our liquid-cooled capacity will grow to over 20% of our ML capacity, which is at multi-gigawatt scale today. While liquid cooling technology itself isn't unique, our approach was. Creating something this effective that could be deployed across our 120 Availability Zones in 38 Regions was significant. Because this solution didn't exist in the market, we developed a system that enables greater liquid cooling capacity with a smaller physical footprint, while maintaining flexibility and efficiency. Our IRHX can support a wide range of racks requiring liquid cooling, uses 9% less water than fully-air cooled sites, and offers a 20% improvement in power efficiency compared to off-the-shelf solutions. And because we invented it in-house, we can deploy it within months in any of our data centers, creating a flexible foundation to serve our customers for decades to come. Reimagining and innovating at scale has been something Amazon has done for a long time and one of the reasons we’ve been the leader in technology infrastructure and data center invention, sustainability, and resilience. We're not done… there's still so much more to invent for customers.

The Netherlands is exploring innovative ways to make data centers more energy-efficient by developing floating data centers that use canal water for cooling. Data centers require enormous amounts of electricity, not only to power servers but also to cool the equipment and prevent overheating. Traditional data centers rely heavily on air-conditioning systems, which consume significant energy and increase operational costs. To reduce this energy demand, engineers in the Netherlands have proposed floating server facilities that use nearby water sources such as canals, lakes, or ports for natural cooling. The concept works by circulating water from the canal through specialized heat exchangers. The water absorbs heat generated by the servers and carries it away, reducing the need for energy-intensive cooling equipment. This method can significantly lower energy consumption and reduce the environmental footprint of large-scale computing infrastructure. Floating data centers also offer additional benefits such as modular construction, flexible deployment, and efficient land use in densely populated cities. The Netherlands, known for its extensive canal networks and expertise in water engineering, provides an ideal environment for testing this approach. As global demand for cloud computing, artificial intelligence, and digital services continues to rise, innovative cooling solutions like floating data centers could play a major role in making the world’s digital infrastructure more sustainable and energy-efficient. #DataCenterInnovation #GreenTechnology #SustainableComputing #TechInfrastructure #FutureEngineering

🔋 Can BESS Replace UPS and Generators in Tier III or IV Data Centers? Over the past few days, I’ve seen several LinkedIn posts positioning Battery Energy Storage Systems (BESS) as a potential replacement for traditional backup systems in data centers — namely, UPS and diesel generators — even in environments certified under the Uptime Institute standard. From a technical standpoint, yes, it is possible. 📘 Tier III requires redundant capacity components and concurrent maintainability. 📘 Tier IV adds fault tolerance, compartmentalization, continuous cooling, and automatic fault response. So far, BESS could theoretically comply. But when we look at replacing generators, the requirements become more complex. 💡 According to the Uptime Institute, a generator must have a minimum fuel reserve to guarantee 12 hours of continuous operation. Therefore, if we want to replace generators with BESS, the systems must be capable of: 🔹 Fully supporting the total load (e.g., 1,500 kW for a 1,000 kW IT load with a dPUE of 1.5) 🔹 Providing at least 12 hours of autonomy → 18,000 kWh of usable storage 🆚 In comparison, a traditional diesel generator for that capacity would be around 2,000 kVA (depending on altitude derating), compliant with ISO 8528-1, and paired with a ~50,000-liter fuel tank. And this leads to a series of practical questions: ❓ Which solution is more cost-effective in terms of CAPEX and OPEX? ❓ How long would it take to fully recharge the BESS after a discharge event? ❓ What happens if the outage lasts more than 12 hours? ❓ How do we mitigate the fire risk associated with lithium-ion batteries — especially in Europe, where this is a growing concern? 🔎 So, can UPS and Generators be replaced by BESS? 📌 Technically, yes. 📌 But operationally and economically? That’s still debatable. Based on my experience in planning, design, construction, and operation of data centers, I still don’t believe it makes full sense to replace UPS and generators with BESS. However, the conversation is open — and it’s one worth having, especially in this new era of data centers, where innovation must go hand in hand with operational and energy efficiency. #DataCenters #BESS #UptimeInstitute #TierIII #TierIV #Resilience #CriticalDesign #PowerInfrastructure #EnergyEfficiency

The next era of datacenters is here. The demand for AI is growing rapidly, and with it comes the need to grow the cloud’s physical footprint. Historically, datacenters have been water-intensive and require using large amounts of higher carbon materials like steel. At Microsoft, we're building datacenters with sustainability in mind, and we're constantly innovating to find new ways to reduce our environmental impact. This includes: 🤝 A first-of-its-kind agreement with Stegra, backed by an investment from Microsoft’s Climate Innovation Fund (CIF) in 2024, to procure near zero-emissions steel from Stegra’s new plant in Boden, Sweden, for use in our datacenters. Powered by renewable energy and green hydrogen, Stegra's facility reduces CO2 emissions by up to 95% versus conventional steel production. By committing to purchase this green steel before it rolls off the line, Microsoft is sending a clear market signal, driving demand for cleaner materials and supporting Stegra’s growth. 💧 We also announced a major breakthrough to make our datacenters more sustainable: microfluidic in-chip cooling technology. Unlike traditional cold plates that sit atop chips, microfluidics brings cooling right inside the silicon itself. Engineers carve microscopic channels directly into the chip, letting liquid coolant flow through and absorb heat exactly where it’s generated. This approach is up to three times more effective than current methods. More efficient cooling allows datacenters to support powerful next-gen AI chips without ramping up energy use or investing in costly new gear. 💵 Through our CIF investments, we’ve catalyzed billions in follow-on capital for breakthrough solutions in low-carbon materials, sustainable fuels, carbon removal, and more. We just released a new whitepaper – Building Markets for Sustainable Growth – that distills five key lessons on how catalytic investment and partnership can move markets and accelerate a global transition in energy, waste, water, and ecosystems. Our journey toward sustainable datacenters is only beginning, and we recognize true progress requires collective action and investment. Read more from Building Markets for Sustainable Growth: https://msft.it/6041sq9xD

As grid operators and planners deal with a wave of new large loads on a resource-constrained grid, we need fresh approaches beyond just expecting reduced electricity use under stress (e.g. via recent PJM flexible load forecast or via Texas SB 6). While strategic curtailment has become a popular talking point for connecting large loads more quickly and at lower cost, this overlooks a more flexible, grid-supportive strategy for large load operators. Especially for loads that cannot tolerate any load curtailment risk (like certain #datacenters), co-locating #battery #energy storage systems (BESS) in front of the load merits serious consideration. This shifts the paradigm from “reduce load at utility’s command” to “self-manage flexibility.” It’s BYOB – Bring Your Own Battery and put it in front of the load. Studies have shown that if a large load agrees to occasional grid-triggered curtailment, this unlocks more interconnection capacity within our current grid infrastructure. But a BYOB approach can unlock value without the compromise of curtailment, essentially allowing a load to meet grid flexibility obligations while staying online. Why do this? For data centers (DC’s), it’s about speed to market and enhanced reliability. The avoidance of network upgrade delays and costs, along with the value of reliability, in many cases will justify the BESS expense. The BYOB approach decouples flexibility from curtailment risk with #energystorage. Other benefits of BYOB include: -Increasing the feasible number of interconnection locations. -Controlling coincident peak costs, demand charges, and real-time price spikes. -Turning new large loads into #grid assets by improving load shape and adding the ability to provide ancillary services. No solution is perfect. Some of the challenges with the BYOB approach include: -The load developer bears the additional capital and operational cost of the BESS. -Added complexity: Integrating a BESS with the grid on one side and a microgrid on the other is more complex than simply operating a FTM or BTM BESS. -Increased need for load coordination with grid operators to maintain grid reliability. The last point – large loads needing to coordinate with grid operators - is coming regardless. A recent NERC white paper shows how fast-growing, high intensity loads (like #AI, crypto, etc.) bring new #electricty reliability risks when there is no coordination. The changing load of a real DC shown in the figure below is a good example. With more DC loads coming online, operators would be severely challenged by multiple >400 MW loads ramping up or down with no advanced notice. BYOB’s can manage this issue while also dealing with the high frequency load variations seen in the second figure. References in comments. 

AWS Builds Custom Liquid Cooling System for Data Centers Amazon Web Services (AWS) is sharing details of a new liquid cooling system to support high-density AI infrastructure in its data centers, including custom designs for a coolant distribution unit and an engineered fluid. “We've crossed a threshold where it becomes more economical to use liquid cooling to extract the heat,” said Dave Klusas, AWS’s senior manager of data center cooling systems, in a blog post. The AWS team considered multiple vendor liquid cooling solutions, but found none met its needs and began designing a completely custom system, which was delivered in 11 months, the company said. The direct-to-chip solution uses a cold plate placed directly on top of the chip. The coolant, a fluid specifically engineered by AWS, runs in tubes through the sealed cold plate, absorbing the heat and carrying it out of the server rack to a heat rejection system, and then back to the cold plates. It’s a closed loop system, meaning the liquid continuously recirculates without increasing the data center’s water consumption. AWS also developed a custom coolant distribution unit, which it said is more powerful and more efficient than its off-the-shelf competitors. “We invented that specifically for our needs,” Klusas says. “By focusing specifically on our problem, we were able to optimize for lower cost, greater efficiency, and higher capacity.” Klusas said the liquid is typically at “hot tub” temperatures for improved efficiency. AWS has shared details of its process, including photos: https://lnkd.in/e-D4HvcK

THE TECHNOLOGY BEHIND FLUORINATED INSULATION LIQUID AND IMMERSION COOLING. 1. Fluorinated insulation liquids are engineered fluids that do not conduct electricity, making them ideal for cooling electronics directly. 2. These liquids are chemically inert, meaning they don’t corrode or react with components, ensuring long-term reliability. 3. They have high dielectric strength, allowing safe immersion of high-voltage devices like servers, transformers, and supercomputers. 4. Used in immersion cooling, hardware is fully or partially submerged in the liquid to efficiently dissipate heat. 5. These liquids typically include perfluorocarbons (PFCs) or fluoroketones, which are stable and thermally efficient. 6. Immersion cooling eliminates the need for traditional fans or air conditioning, drastically reducing energy consumption. 7. The liquids have low viscosity, allowing better flow and even heat distribution around all hardware surfaces. 8. Fluorinated liquids are non-flammable and thermally stable up to high temperatures, making them safe in demanding environments. 9. In data centers, immersion cooling using these fluids allows for higher server density, saving space and infrastructure costs. 10. These liquids are reusable and recyclable, lowering long-term operating and environmental costs. 11. They support quiet operations since there are no moving fan parts or airflow systems involved. 12. Fluorinated liquids also have low global warming potential when designed with modern eco-safe formulations. 13. They are used in modular data centers, edge computing stations, and blockchain mining farms for heat control. 14. The technology supports zero water usage, unlike traditional cooling towers that consume large volumes. 15. These liquids allow precise thermal control, even in overclocked or mission-critical systems. 16. They're ideal for cooling GPU-intensive tasks like AI processing, VR simulations, and scientific computing. 17. In telecom and defense, immersion cooling using fluorinated liquids offers high system reliability in harsh environments. 18. The liquids are easy to monitor and maintain with sensors that track clarity, temperature, and level. 19. With no air required, there’s no dust buildup, keeping systems cleaner and reducing maintenance cycles. 20. Fluorinated insulation liquids are pushing the future of sustainable high-performance computing, where silence meets power.

Data centers now use 415 TWh of electricity a year. By 2030, that could hit 945 TWh. Cooling alone eats 30–40% of that energy. Fans and air can't keep up with AI chips anymore. Some are looking up. Google, NVIDIA, and startups like Starcloud are exploring data centers in orbit—where solar power is constant and the vacuum of space offers free cooling. No fans. No water. But the hurdles are steep: launch costs, radiation damage, latency, and radiators the size of buildings. Behnood Bazmi looked down instead. A grad student at the University of Illinois, he wasn't chasing AI. He was studying heat. And he kept asking one question: what if cooling is the real bottleneck? His team used algorithms to design copper cooling plates no engineer would sketch. Jagged, branching fins just 30–50 micrometers thick—thinner than a human hair. Too complex for machining. Too intricate for most 3D printing. Then they partnered with Fabric8Labs to build them using electrochemical additive manufacturing at room temperature. What they measured: ↳ 32% lower thermal resistance ↳ 68% less pumping power ↳ Cooling energy drops from ~550 MW to 11 MW in a 1 GW facility ↳ 98% less energy spent keeping chips cool Space data centers may come. But this works now—on Earth, at lab scale, with a path to manufacturing. Sometimes the answer isn't a moonshot. It's a grad student asking a question everyone else stopped asking. 1 question about heat. 10 researchers bridging design and manufacturing. 100 data centers running on a fraction of the energy. What problem have you stopped questioning because it felt too obvious? Follow me, Dr. Martha Boeckenfeld, for insights on thriving as AI rises while leaders stay human. Sources: IEA, Cell Reports Physical Science (May 2026), UIUC, Fabric8Labs https://lnkd.in/euNCgcGg

The Water Footprint of AI: Why We Need to Pay Attention to Its Environmental Cost As artificial intelligence continues to advance, its environmental impact, particularly concerning water consumption in data centres, warrants attention. Understanding AI's Water Usage AI models, especially large language models, require substantial computational resources. This computing power, concentrated in data centres, generates significant heat, necessitating extensive cooling, often through water-based systems. - Per Query Water Usage: Each interaction with AI models like ChatGPT consumes water. For instance, a 20-50 question session can use approximately 500 millilitres of water, primarily for cooling purposes. - Industry Impact: Data centres globally consumed over 660 billion liters of water in 2022 to cool servers running various services, including AI workloads. Key Areas of Concern 1. Water Scarcity: Many data centres are located in regions with limited water resources. In areas like California, where numerous tech companies operate, water-intensive cooling for AI adds strain to local supplies. 2. Seasonal Impact: During summer, data centres often double their water usage to maintain optimal temperatures. With climate change leading to more frequent heatwaves, this demand could increase, exacerbating the impact. 3. Comparative Impact: Training large AI models can consume up to five times more water than traditional data center operations, highlighting the need for efficient resource management. Steps Toward Sustainability To foster a more sustainable AI ecosystem, the tech industry can consider the following measures: 1. Adopt Alternative Cooling Solutions: Implementing methods like liquid immersion cooling, direct air cooling, and utilising recycled water systems can reduce water demands by up to 90% in certain environments. 2. Enhance Transparency and Accountability: Publicly reporting water usage and environmental impact data allows companies to foster accountability and enable informed consumer choices. Currently, only a few tech giants release detailed sustainability reports on water use. 3. Optimise Model Efficiency: Redesigning models to perform with lower computational intensity can significantly reduce both water and energy requirements. Model efficiency improvements, even by 10-15%, can save millions of litres of water annually. While AI offers transformative benefits across various sectors, it's crucial to balance its growth with responsible resource use. Focusing on sustainable AI practices is essential not only for environmental preservation but also for the technology's long-term viability.By embracing these strategies, we can ensure AI's advancement doesn't come at the expense of our planet's resources. Visual: The Times #ai #waterconsumption #sustainability #datacenters #environmentalimpact #greenai

While these discussions are a commonplace occurrence within the data center industry, I frequently come across a recurring question from folks outside the realm: can today's data centers adequately meet the power and cooling needs of the upcoming GPU generation designed for Artificial Intelligence? This naturally leads to inquiries about the implications for future data center designs. Interestingly, we have actually been delivering these solutions for some time now. With existing rack densities already pushing boundaries at 80kW, and the anticipation of even greater densities in the years to come, the subject is undeniably exhilarating. It offers substantial potential for advances in energy efficiency and sustainable outcomes. This sparks excitement not only within the data center community but also for a wider audience interested in the intersection of technology, sustainability, and infrastructure. Thrilling right !! Let’s dive in :) Liquid cooling plays a crucial role in driving the advancement of AI data center design, specifically tailored for high-density operations. With the growing demand for computational power due to the wide-ranging applications of artificial intelligence, effectively managing the heat generated by these systems has become a significant challenge. Traditional air cooling methods struggle to disperse the intense thermal loads produced by the concentrated AI hardware. The introduction of liquid cooling provides a practical solution by offering notably better heat dissipation capabilities compared to air-based alternatives. By utilising a liquid medium (like direct to chip, immersion or rear door heat exchanger), heat can be efficiently directed away from sensitive components, maintaining optimal operating temperatures. This not only enhances the durability and reliability of hardware but also enables the integration of higher power densities and expanded computing potential within limited space. Additionally, liquid cooling simplifies hardware consolidation, leading to a smaller physical footprint for significantly greater power per square meter in your data centre. This reduction translates directly into cost savings in terms of real estate, power consumption, and cooling infrastructure expenses. As AI data centers continue to push the boundaries of computational capabilities, the importance of liquid cooling becomes even more evident. Its adoption ensures sustainable growth and improved performance, while also addressing the challenges associated with effective heat management. At NEXTDC we have deployed a number of MW scale liquid cooling solutions recently in both Melbourne and Sydney, and if you want to learn more, hit me up in the comments below. You can tour water cooled direct to chip, and immersion solutions in production in our facilities today. #ai #gpu #sustainability #wherethecloudlives #whereailives #whereaithrives #liquidcooling #pursuitofexcellence Jeffrey D. Van Zetten Simon Cooper