HyperCube makes use of superior immersion cooling know-how.
Persistent metallic cloud
The growth in synthetic intelligence is rising the demand for extra highly effective processors, in addition to the power wanted to chill knowledge facilities.
That is a chance for knowledge middle firm Sustainable Steel Cloud, which runs “sustainable AI factories” made up of its HyperCubes in Singapore and Australia.
HyperCubes include servers outfitted with Nvidia processors which are immersed in an artificial oil known as polyalphaolefin, which conducts warmth extra effectively than air. The corporate mentioned its platform reduces power consumption by as much as 50 %, in comparison with conventional air-cooling know-how sometimes utilized in knowledge facilities.
“It allows high-density internet hosting for GPUs. It allows the sort of internet hosting we have to see for platforms like [Nvidia’s] Grace Blackwell,” mentioned Tim Rosenfield, co-founder and co-CEO of Sustainable Steel Cloud, referring to the brand new era of AI GPUs Nvidia introduced in March.
The Singapore-based agency additionally mentioned its immersion cooling know-how is 28% cheaper to put in than different liquid-based options. HyperCubes are designed to suit into any knowledge middle and may be positioned in unused areas inside present knowledge facilities.
Most knowledge facilities should not prepared for liquids of any sort, whether or not immersion or direct chip cooling. The market is determining the easiest way to make use of this, and I believe there can be some ways.
Tim Rosenfield
Co-Founder and Co-CEO, Sustainable Steel Cloud
“The truth that our resolution is containerized means we are able to go wherever in a short time. And we are able to open up new areas of availability in response to buyer demand…,” Rosenfield mentioned.
He mentioned SMC is increasing into different markets reminiscent of Thailand and India.
The agency already counts Nvidia and Deloitte amongst its main company companions. SMC is a preferred cloud partner of Nvidia for computing and AI and presents GPU clusters designed by the chip big. In July, SMC introduced a partnership with Deloitte wherein it would present entry to Nvidia’s GPU computing infrastructure for the consultancy’s purchasers to construct AI functions.
Governments and companies have rushed to seize the transformative influence of AI, and demand for knowledge facilities is booming consequently.
Nations like Singapore, the place SMC is headquartered, are additionally seeking to scale back heavy power consumption by way of pushing for “green” data centers to help its AI ambitions, the place the nation has taken greater than S$500 million ($379.7 million).
Sustainable Steel Cloud acquired funding from Singapore state investor Temasek, backed by ST Telemedia World Information Centres, considered one of Asia’s largest knowledge middle operators.
SMC is currently rising $400 million in fairness and $550 million in debt, with the funds going towards knowledge middle growth exterior Singapore, Bloomberg reported, citing sources accustomed to the matter.
Liquid cooling is gaining momentum
Know-how firms are more and more seeking to liquid cooling for his or her knowledge facilities as rising efficiency calls for additionally improve the dangers of overheating.
Historically, knowledge facilities have giant corridors to permit cooled air to flow into, as overheating could cause tools harm and outages. In concept, liquid cooling ought to permit these services to pack extra servers into their present footprint.
Giordano Albertazzi, CEO of digital infrastructure supplier Vertiv, advised CNBC in June that the adoption of liquid cooling may speed up in 2024. Vertiv’s thermal administration choices embrace hybrid air and liquid cooling, in addition to facilities for knowledge with full liquid cooling.
Throughout Computex Taipei in June, Nvidia CEO Jensen Huang protect the advantages of Supermicro’s direct liquid cooling technologywhich he says saves power and lowers prices in AI knowledge facilities.
Servers are immersed in oil in container-like “hypercubes” to attract warmth effectively.
Persistent metallic cloud
Supermicro CEO Charles Liang advised CNBC in June that liquid cooling is extra power environment friendly, main to raised efficiency, much less air pollution and decrease power prices.
Regardless of the fanfare, challenges stay in implementing liquid cooling, in line with SMC’s Rosenfield.
“Most knowledge facilities should not prepared for fluids of any variety, whether or not it is immersion or direct chip cooling. The market is determining the easiest way to make use of that, and I believe there can be numerous methods,” Rosenfield mentioned.
Vertiv’s Albertazzi mentioned, “There’s nonetheless numerous air cooling that is nonetheless taking place within the knowledge middle and can proceed to occur even within the full AI density knowledge middle.”
