Keynote by Wes Cummins, CEO and Co-Founder of Applied Digital | RAISE Summit 2024 | Paris
Wes Cummings, founder and CEO of Applied Digital, presented on the intersection of AI growth and power scarcity, emphasizing the company's pivot to purpose-built infrastructure located at points of power generation.
- Applied Digital originally built 500 megawatts of capacity over 24 months for blockchain/Bitcoin mining (ASICs) starting three years ago.
- In 2022, the company designed and began constructing HPC-style, high-power-density liquid-cooled data centers.
- The company launched a commercial cloud GPU service in May of the previous year, citing Character AI and Together AI as early enterprise customers.
- Current projects aim to deliver 400+ megawatts of power capacity while co-locating with renewable energy sources to minimize carbon footprints and PUE.
Power scarcity has intensified from a significant challenge to a critical bottleneck due to the surge in AI demand, specifically driven by NVIDIA H100 GPUs.
- The "hunt for power" is estimated to be 10 to 20 times larger today than during the blockchain mining boom.
- One utility provider example illustrates the scale: a 5-gigawatt grid recently received 15 gigawatts of new data center power requests within nine months.
- The US data center market has cumulatively built 23 gigawatts over the last 30 years, contrasting sharply with current forecasts requiring massive new capacity.
Forecasted demand for data center power through 2030 presents a supply-side challenge that exceeds historical build-out rates.
- Independent forecasts suggest a need for 37 gigawatts of DC capacity by 2030; some hyperscaler CEOs project 100 gigawatts may be required solely to serve the three largest hyperscalers.
- This anticipated volume would represent approximately four times the total US data center capacity built in the prior three decades.
Strategic infrastructure placement involves moving facilities away from population centers (traditional low-latency zones) to "points of power generation" where grid congestion often limits transport.
- Facilities are co-located with renewable sources, such as wind farms in North Dakota (the 6th largest wind producer in North America but 48th in population).
- Applied Digital utilizes curtailed renewable energy that would otherwise be wasted due to grid overload or negative pricing.
- AI workloads (training and inference) can tolerate higher latency than real-time applications like video streaming, enabling this shift in geographic strategy.
Operational capabilities focus on high power density and liquid cooling to support intensive AI workloads.
- The company currently deploys thousands of H100 GPUs across multiple sites.
- Sites are optimized for both training and inference applications while maintaining ultra-low Power Usage Effectiveness (PUE).
- The company anticipates that power capacity constraints will become a visibly dominant issue in 2024 and beyond.