Where AGI timelines go wrong | Toby Ord, Oxford University
Toby Ord argues that while recursive self-improvement could compress years of AI progress into a single year, significant technical hurdles regarding strategic decision-making and data limitations likely prevent an immediate vertical intelligence explosion, projecting a median transformative AI date around 2038. He identifies four primary risks from rapid acceleration—including the loss of human monitoring and winner-takes-all dynamics—advocating for specific governance measures such as moratoriums on unmonitorable chain-of-thought models and international treaties to mitigate existential threats. Ultimately, Ord recommends a broad-timeline portfolio strategy that balances immediate safety verification efforts with long-term foundational work, acknowledging high uncertainty while preparing for scenarios where AI capabilities evolve faster than current alignment research can address.