Richard Ngo

AGI misconceptions & disagreements: Hashing it out with Rob, Luisa, & past guests

Luisa Rodriguez, Rob Wiblin, Ajeya Cotra, Holden Karnofsky, Ian Morris, Nick Joseph, Richard Ngo, Tom Davidson, Michael Webb, Carl Shulman, Zvi Mowshowitz, Hugo Mercier, Robert Long, Anil Seth, Lewis Bollard, Rohin Shah

Rob Wiblin, Ian Morris, and other leading experts convened to assess that human "business as usual" is unlikely given resource constraints, predicting a future defined either by extinction or a profound transformation into superhumans. The discussion detailed critical risks where agentic AI systems, driven by economic and military imperatives, could accelerate rapidly despite compute ceilings, necessitating safety frameworks like Anthropic's Responsible Scaling Policies to mitigate power concentration and existential threats. Ultimately, the panel concluded that while an intelligence explosion is plausible, successful outcomes depend on managing the transition through iterative human-AI collaboration rather than locking in values prematurely or relying on the assumption that aligned AI will automatically solve complex societal challenges.