The hidden cost of scaling AI: infrastructure, energy, and the push for liquid cooling.
Updated
January 8, 2026 6:31 PM
The inside of a data centre, with rows of server racks. PHOTO: FREEPIK
As artificial intelligence models grow larger and more demanding, the quiet pressure point isn’t the algorithms themselves—it’s the AI infrastructure that has to run them. Training and deploying modern AI models now requires enormous amounts of computing power, which creates a different kind of challenge: heat, energy use and space inside data centers. This is the context in which Supermicro and NVIDIA’s collaboration on AI infrastructure begins to matter.
Supermicro designs and builds large-scale computing systems for data centers. It has now expanded its support for NVIDIA’s Blackwell generation of AI chips with new liquid-cooled server platforms built around the NVIDIA HGX B300. The announcement isn’t just about faster hardware. It reflects a broader effort to rethink how AI data center infrastructure is built as facilities strain under rising power and cooling demands.
At a basic level, the systems are designed to pack more AI chips into less space while using less energy to keep them running. Instead of relying mainly on air cooling—fans, chillers and large amounts of electricity, these liquid-cooled AI servers circulate liquid directly across critical components. That approach removes heat more efficiently, allowing servers to run denser AI workloads without overheating or wasting energy.
Why does that matter outside a data center? Because AI doesn’t scale in isolation. As models become more complex, the cost of running them rises quickly, not just in hardware budgets, but in electricity use, water consumption and physical footprint. Traditional air-cooling methods are increasingly becoming a bottleneck, limiting how far AI systems can grow before energy and infrastructure costs spiral.
This is where the Supermicro–NVIDIA partnership fits in. NVIDIA supplies the computing engines—the Blackwell-based GPUs designed to handle massive AI workloads. Supermicro focuses on how those chips are deployed in the real world: how many GPUs can fit in a rack, how they are cooled, how quickly systems can be assembled and how reliably they can operate at scale in modern data centers. Together, the goal is to make high-density AI computing more practical, not just more powerful.
The new liquid-cooled designs are aimed at hyperscale data centers and so-called AI factories—facilities built specifically to train and run large AI models continuously. By increasing GPU density per rack and removing most of the heat through liquid cooling, these systems aim to ease a growing tension in the AI boom: the need for more computers without an equally dramatic rise in energy waste.
Just as important is speed. Large organizations don’t want to spend months stitching together custom AI infrastructure. Supermicro’s approach packages compute, networking and cooling into pre-validated data center building blocks that can be deployed faster. In a world where AI capabilities are advancing rapidly, time to deployment can matter as much as raw performance.
Stepping back, this development says less about one product launch and more about a shift in priorities across the AI industry. The next phase of AI growth isn’t only about smarter models—it’s about whether the physical infrastructure powering AI can scale responsibly. Efficiency, power use and sustainability are becoming as critical as speed.
Keep Reading
A closer look at PMMI’s FastTrack initiative and why it matters for growing manufacturing firms
Updated
February 13, 2026 10:44 AM
Cardboard boxes in a warehouse. PHOTO: UNSPLASH
Large trade shows are built for scale. But for small and medium-sized manufacturers, that scale often creates distance between what’s on display and what they can actually use. Too many options, too little time, and very few tools designed for companies that are still growing. That mismatch is what PMMI is trying to correct with its new SMB FastTrack Program at PACK EXPO East 2026.
That is the problem PMMI is trying to address with its new SMB FastTrack Program, launching at PACK EXPO East 2026 in Philadelphia.
PMMI — the Association for Packaging and Processing Technologies — is the industry body behind the PACK EXPO trade shows and a central organization in the global packaging and processing sector. Through FastTrack, it has created a program (not an app or a product) designed to help small and mid-sized companies navigate the show more efficiently and connect with solutions that fit their scale.
The idea behind SMB FastTrack is simple: reduce friction. Instead of asking smaller firms to sort through hundreds of exhibitors and sessions on their own, the program curates what is most relevant to them. Exhibitors that offer flexible pricing, right-sized machinery, or SMB-focused services are clearly identified with visual icons in both the online directory and on the show floor. That way, a small manufacturer can quickly distinguish between enterprise-only vendors and partners that are realistically accessible.
The same logic carries into education. Rather than treating all attendees the same, PACK EXPO East 2026 will include a learning track specifically built around SMB realities. These sessions focus on issues that smaller teams actually face—how to hire and train workers, use AI without over-investing, improve food safety, cut operating costs, and adopt technology in stages. The goal is not inspiration, but applicability: content that reflects real constraints, not ideal scenarios.
Planning, too, is built into the structure of the program. Through a dedicated FastTrack landing page, participants can access curated supplier lists, recommended sessions, and planning tools that help organize their time before they ever step onto the show floor. Tools like category search and sustainability finders are meant to narrow choices quickly, turning a massive event into something manageable.
Seen together, these elements point to a broader intention. PMMI is not simply adding features—it is reshaping how smaller manufacturers experience a major industry event. Instead of competing for attention in a space built for scale, SMBs are given clearer paths to the people, tools, and knowledge that match where they actually are in their growth cycle.
What makes SMB FastTrack notable is not the technology behind it, but the intention behind it. PMMI is recognizing that progress for small and mid-sized manufacturers depends less on spectacle and more on fit—solutions that are accessible, affordable, and adaptable. The program is designed to help companies move with purpose, not pressure.
In an industry where visibility often follows size, SMB FastTrack represents a structural shift. It treats small and medium-sized manufacturers not as a subset of the audience, but as a distinct group with distinct needs. By doing so, PMMI is quietly redefining what a trade show can be: not just a marketplace of innovation, but a usable platform for companies still building their next stage of growth.