newsfilter
← Interviews
80,000 Hours2h 54m

Graphs AI Companies Would Prefer You To Misunderstand | Toby Ord, Oxford University

Toby Ord

Interview

The AI industry is pivoting from pre-training scaling to computationally expensive inference scaling, a shift that is depleting efficiency, altering market economics in favor of hardware manufacturers, and creating tiered access to superhuman intelligence. This transition necessitates a return to reinforcement learning, which introduces new safety risks like reward hacking while undermining existing regulatory frameworks that rely on fixed compute thresholds to monitor dangerous capabilities. Consequently, experts warn that without exploring radical governance strategies such as moratoriums or legal personhood, the widening gap between technical optimism and public fear could lead to catastrophic economic inequality and uncontrolled safety incidents.