Beren Millidge
Showing 1–3 of 3 transcripts.
- Dwarkesh Patel1h 37m
AI researchers debate how close we are to recursive self-improvement
John Schulman, Charlie O’Neill, Beren Millidge
Experts predict that while AI will function as full-time remote workers within three years, exponential takeoff before 2036 remains unlikely due to persistent generalization bottlenecks and sample efficiency gaps that prevent narrow benchmarks from scaling to broad real-world domains. The prevailing consensus suggests current architectures will plateau under diminishing returns on scaling, forcing a reliance on distillation and human-defined objectives rather than recursive self-improvement to drive the projected tenfold researcher productivity gains. Consequently, a dominant "ASI" model capable of mastering every cognitive and physical field is forecast only within five to ten years, contingent on overcoming fundamental barriers in non-cumulative task learning and environment creation.
- 80,000 Hours15 min
You can't win a war in space
This analysis concludes that in a universe without faster-than-light travel, the inherent physics of interstellar distances grants overwhelming defensive advantages to mature civilizations, rendering large-scale conquest irrational. The study details how mobile habitats, relativistic kill vehicle defenses, and distributed sensor networks create insurmountable barriers for invading fleets, effectively negating the "Dark Forest" hypothesis of constant galactic warfare. Consequently, the document warns that humanity faces a critical existential threat over the next ten millennia unless it rapidly transitions from a vulnerable single-planet state to a dispersed, mobile infrastructure comparable to a Kardashev III civilization.
- Dwarkesh Patel13 min
What are we scaling?
Baron Millage argues that current Reinforcement Learning strategies rely on inefficiently pre-baking skills into models due to a fundamental misunderstanding of their ability to learn like humans, which keeps AI revenue far below the potential of knowledge work automation. While the industry anticipates a 2030 surge in continual learning revenue reaching the hundreds of billions, the lack of generalizable on-the-job capabilities and the immense compute requirements for RL scaling suggest AGI remains distant despite incremental progress. This perspective challenges the "superhuman researcher" narrative by emphasizing that solving the core learning problem requires a shift from specialized training loops to systems capable of semantic, self-directed adaptation.