The hidden cost of scaling AI: infrastructure, energy, and the push for liquid cooling.
Updated
January 8, 2026 6:31 PM

The inside of a data centre, with rows of server racks. PHOTO: FREEPIK
As artificial intelligence models grow larger and more demanding, the quiet pressure point isn’t the algorithms themselves—it’s the AI infrastructure that has to run them. Training and deploying modern AI models now requires enormous amounts of computing power, which creates a different kind of challenge: heat, energy use and space inside data centers. This is the context in which Supermicro and NVIDIA’s collaboration on AI infrastructure begins to matter.
Supermicro designs and builds large-scale computing systems for data centers. It has now expanded its support for NVIDIA’s Blackwell generation of AI chips with new liquid-cooled server platforms built around the NVIDIA HGX B300. The announcement isn’t just about faster hardware. It reflects a broader effort to rethink how AI data center infrastructure is built as facilities strain under rising power and cooling demands.
At a basic level, the systems are designed to pack more AI chips into less space while using less energy to keep them running. Instead of relying mainly on air cooling—fans, chillers and large amounts of electricity, these liquid-cooled AI servers circulate liquid directly across critical components. That approach removes heat more efficiently, allowing servers to run denser AI workloads without overheating or wasting energy.
Why does that matter outside a data center? Because AI doesn’t scale in isolation. As models become more complex, the cost of running them rises quickly, not just in hardware budgets, but in electricity use, water consumption and physical footprint. Traditional air-cooling methods are increasingly becoming a bottleneck, limiting how far AI systems can grow before energy and infrastructure costs spiral.
This is where the Supermicro–NVIDIA partnership fits in. NVIDIA supplies the computing engines—the Blackwell-based GPUs designed to handle massive AI workloads. Supermicro focuses on how those chips are deployed in the real world: how many GPUs can fit in a rack, how they are cooled, how quickly systems can be assembled and how reliably they can operate at scale in modern data centers. Together, the goal is to make high-density AI computing more practical, not just more powerful.
The new liquid-cooled designs are aimed at hyperscale data centers and so-called AI factories—facilities built specifically to train and run large AI models continuously. By increasing GPU density per rack and removing most of the heat through liquid cooling, these systems aim to ease a growing tension in the AI boom: the need for more computers without an equally dramatic rise in energy waste.
Just as important is speed. Large organizations don’t want to spend months stitching together custom AI infrastructure. Supermicro’s approach packages compute, networking and cooling into pre-validated data center building blocks that can be deployed faster. In a world where AI capabilities are advancing rapidly, time to deployment can matter as much as raw performance.
Stepping back, this development says less about one product launch and more about a shift in priorities across the AI industry. The next phase of AI growth isn’t only about smarter models—it’s about whether the physical infrastructure powering AI can scale responsibly. Efficiency, power use and sustainability are becoming as critical as speed.
Keep Reading
Amid AI and tech startups, Eastseabrother proved the power of demand and trust.
Updated
January 23, 2026 10:41 AM

Cats having a jolly good time with a can of tuna. PHOTO: UNSPLASH
At a Silicon Valley pitch event crowded with AI, SaaS and deep-tech startups, the company that stood out was not selling software or algorithms. It was selling pet treats.
Eastseabrother, a premium pet food brand from South Korea, ranked first at a Plug and Play–hosted investor pitch competition in Sunnyvale. The product itself is simple: single-ingredient pet treats made from wild-caught seafood sourced from Korea’s East Sea. The company follows a principle it calls “Only What the Sea Allows”, working directly with regional fishermen while avoiding overfishing. With no additives and minimal processing, what sets Eastseabrother apart is not novelty, but control—over sourcing, supply chains and consistency.
That clarity helped the company walk away with both Best Product and Best Potential. “Investors asked detailed questions about repeat purchase rates and customer feedback, not just our technology or supply chain”, said Eunyul Kim, CEO of Eastseabrother. “That told us the market is shifting—real consumer trust now carries as much weight as a compelling tech narrative”.
What truly caught investors’ attention was not an ambitious vision of the future, but concrete evidence of traction today. Eastseabrother has already secured shelf space in specialty pet stores across California, New York and North Carolina, including an exclusive partnership with EarthWise Pet, a national specialty retail chain. At a consumer showcase at San Francisco’s Ferry Building, the brand recorded the highest on-site sales among all participating companies.
At its core, the pitch was built on simplicity: one ingredient, clear sourcing and a defined customer need. In a market saturated with complex products and abstract claims, that focus and transparency stood out.
The judges’ decision also reflects a broader shift in venture capital thinking. Not every successful startup is built on complex software or high-tech innovation. In categories like pet care—where trust, quality and transparency shape buying behavior—execution and credibility can matter more than technical sophistication.
Today, Eastseabrother has extended its reach beyond the U.S., expanding into Singapore and Hong Kong, with additional plans to grow further in North America as demand for premium pet food rises. And the broader takeaway from this pitch is not that consumer brands are overtaking tech startups. It is that investors are increasingly focused on fundamentals: who is buying, why they are returning and whether the business can sustain itself beyond the pitch deck.