Ilya
Showing 1–5 of 5 transcripts.
- Dwarkesh Patel2h 14m
How GPT, Claude, and Gemini are actually trained and served – Reiner Pope
John Mueller Jr. discusses the technical and economic drivers behind AI inference architectures, detailing how startups like Maddox optimize for memory bandwidth bottlenecks and latency bounds in sparse Mixture of Experts models. The analysis highlights that frontier models are currently overtrained by a factor of 100x relative to scaling laws, a phenomenon that dictates current API pricing structures for context length and caching tiers. Finally, Mueller explains how industry scaling is shifting toward larger single-rack domains to maximize expert parallelism while utilizing reversible network techniques to mitigate training memory constraints.
- RAISE Summit42 min
RAISE Panel 2025: The AGI Ascent Climbing Toward Superhuman Intelligence
Chase Lockmiller, Ilya, Peter, Sarah, Biang, Dario
A diverse panel of industry leaders and researchers analyzed the trajectory of artificial general intelligence, identifying energy scarcity and data quality as primary constraints while debating the future of centralized versus decentralized model architectures. Discussion highlighted a strategic shift toward massive test-time compute and human-AI collaboration, contrasting fears of cognitive atrophy with the potential for AI to automate outcome-based tasks while preserving process-driven human uniqueness. Experts concluded that regulatory frameworks must evolve alongside technological speed, with the consensus that AGI remains a moving target defined by the symbiotic relationship between human creativity and machine capabilities.
- Lex Fridman1h 55m
Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI | Lex Fridman Podcast #419
Sam Altman, Elon Musk, Ilya, Lex Fridman
OpenAI CEO Sam Altman predicts that compute will become the world's most valuable strategic commodity, necessitating a global surge in nuclear energy investment to power AI systems capable of accelerating scientific discovery by 2030. Following the 2023 governance crisis that resulted in his temporary ousting, Altman details the establishment of a more accountable board structure and his firm rejection of unilateral control over AGI development. He outlines a technical roadmap emphasizing robust safety protocols against misinformation and political manipulation while preparing for future models with trillion-token context windows and advanced reasoning capabilities.
- Dwarkesh Patel7 min
How Did Dario & Ilya Know LLMs Could Lead to AGI?
OpenAI co-founders Ilya Sutskever and the speaker pioneered the hypothesis that general intelligence emerges by removing structural learning barriers and scaling data and compute rather than relying on specific domain engineering. Their research identified seven critical success factors, culminating in the Transformer architecture which eliminated context-window limitations and established language modeling as a substrate for complex reasoning. This strategy was validated by Alec Radford's GPT-1, confirming that massive scaling enables models to generalize across diverse tasks, a trajectory the founders view as having no inherent limits.
- Y Combinator2h 28m
Work at a Startup Expo 2019
Ryan Choi, Geoff Ralston, Vijay, Tanay, Anjana Rajan, Jonathan, Greg, Julia, Daniele, Mike, David, Ning, Paul, Samir Maghani, Tarek, Lior, Chris Nguyen, Erica, Wei, Lyle Avery, Gregory Coburger, Adam McKenzie, Jacob, Parker Conrad, Ilya, Lester, Josh, Jordan, Marc Friedman, Hugh, Ethan, Hanan, Reese
Y Combinator hosted a high-stakes hiring expo featuring 40 funded startups, where founders pitched their missions and technical stacks to engineers in a rapid-fire, two-hour format. The event highlighted diverse sectors ranging from healthcare AI and fintech to autonomous logistics, utilizing a digital directory to match attendees with companies like Checkr, Glide, and Scale. By emphasizing rapid career growth and high-impact environments over corporate stability, the gathering successfully connected over 2,000 alumni founders with talent to advance products that currently serve millions of users.