Fireside Chat, Interview
Stanford MS&E435 Economics of the AI Supercycle | Spring 2026 | Applications, Applied AI
- Inference capacity demand is projected to increase by a factor of one billion over a timeframe where the speaker notes an ongoing uptick in velocity, with Base10 anticipating a need for approximately 150,000 B200-equivalent compute units in two years.
- To meet this two-year demand requiring an estimated seven billion dollars in compute spend, Base10 plans to own hardware directly rather than renting, as rental access is predicted to be unavailable and direct ownership is estimated to be 30% cheaper.
- The market is expected to shift spending away from frontier models, which currently consume 90% to 95% of inference spend, toward custom and post-trained models as companies seek gross margins between 40% and 70% to achieve viable business models.
- Open source models are predicted to remain approximately 90 days behind closed-source frontier models in capability while offering a 70% to 90% cost reduction, potentially driven by U.S. government incentives to counter national security risks posed by Chinese dominance.
- Compute scarcity is forecasted to persist indefinitely without a reset period due to compounding demand from agentic applications and larger models, creating an existential pressure for large companies to adopt cheaper open or post-trained alternatives.
- Base10 intends to transition its revenue model to charge per token for post-training workflows rather than solely marking up compute, aiming to improve user experience through better latency and reliability.
- The speaker identifies significant risks for companies relying exclusively on frontier labs, including the loss of unique workflows and data, and highlights a parallel trend where modular data centers could standardize compute units similar to shipping containers.
- The current compute deal market is characterized as immature and inefficient, comparable to a drug market or electricity markets, while the speaker also expresses a contingency plan to invest in energy and power infrastructure if Base10 is not built.