newsfilter.io

Toby Ord

Showing 17 of 7 transcripts.

  1. 80,000 Hours2h 46m

    Where AGI timelines go wrong | Toby Ord, Oxford University

    Toby Ord, Rob Wiblin

    Toby Ord argues that while recursive self-improvement could compress years of AI progress into a single year, significant technical hurdles regarding strategic decision-making and data limitations likely prevent an immediate vertical intelligence explosion, projecting a median transformative AI date around 2038. He identifies four primary risks from rapid acceleration—including the loss of human monitoring and winner-takes-all dynamics—advocating for specific governance measures such as moratoriums on unmonitorable chain-of-thought models and international treaties to mitigate existential threats. Ultimately, Ord recommends a broad-timeline portfolio strategy that balances immediate safety verification efforts with long-term foundational work, acknowledging high uncertainty while preparing for scenarios where AI capabilities evolve faster than current alignment research can address.

  2. 80,000 Hours1h 38m

    2025 Highlight-o-thon: Oops! All Bests

    Kyle Fish, Ian Dunt, Sam Bowman, Buck Shlegeris, Luisa, Rob, Helen Toner, Hugh White, Paul Scharre, Beth Barnes, Tyler Whitmer, Toby Ord, Andrew Snyder-Beattie, Eileen Yam, Will MacAskill, Neel Nanda, Tom Davidson, Marius Hobbhahn, Holden Karnofsky, Allan Dafoe, Ryan Greenblatt, Daniel Kokotajlo, Dean Ball

    This forum convened experts to debate the accelerating timeline of AGI by 2029 while critiquing US geopolitical strategies for abandoning global primacy in favor of a multipolar order. Participants examined critical risks including AI scheming, biological defense asymmetries, and the erosion of human context in warfare, contrasting them with corporate reforms at OpenAI and the rising costs of AI inference. The discourse further highlighted the widening perception gap between AI developers and the public, the potential of mechanistic interpretability as an "AI biology," and the structural necessity of aligning urban planning with community quality of life rather than NIMBYism.

  3. Dwarkesh Patel13 min

    What are we scaling?

    Toby Ord, Beren Millidge

    Baron Millage argues that current Reinforcement Learning strategies rely on inefficiently pre-baking skills into models due to a fundamental misunderstanding of their ability to learn like humans, which keeps AI revenue far below the potential of knowledge work automation. While the industry anticipates a 2030 surge in continual learning revenue reaching the hundreds of billions, the lack of generalizable on-the-job capabilities and the immense compute requirements for RL scaling suggest AGI remains distant despite incremental progress. This perspective challenges the "superhuman researcher" narrative by emphasizing that solving the core learning problem requires a shift from specialized training loops to systems capable of semantic, self-directed adaptation.

  4. 80,000 Hours2h 54m

    Graphs AI Companies Would Prefer You To Misunderstand | Toby Ord, Oxford University

    Toby Ord

    The AI industry is pivoting from pre-training scaling to computationally expensive inference scaling, a shift that is depleting efficiency, altering market economics in favor of hardware manufacturers, and creating tiered access to superhuman intelligence. This transition necessitates a return to reinforcement learning, which introduces new safety risks like reward hacking while undermining existing regulatory frameworks that rely on fixed compute thresholds to monitor dangerous capabilities. Consequently, experts warn that without exploring radical governance strategies such as moratoriums or legal personhood, the widening gap between technical optimism and public fear could lead to catastrophic economic inequality and uncontrolled safety incidents.

  5. 80,000 Hours3h 7m

    The perils of maximising the good that you do | Toby Ord

    Toby Ord, Rob

    Toby Ord analyzes the FTX collapse as a critical failure of character where flawed integrity multiplied negative impact, prompting a revised emphasis on "earnestness" and avoiding pure outcome maximization within the effective altruism community. He further details urgent shifts in global consensus regarding AI existential risks, advocating for international cooperation and hyperreal mathematical frameworks to address infinite ethics and long-termism. Ord concludes by highlighting his "Earth Restored" project as a concrete demonstration of preserving high-quality historical data while urging the movement to prioritize robust governance over rapid, unregulated expansion.

  6. Dwarkesh Patel2h 21m

    Fin Moorhouse - Longtermism, Space, & Entrepreneurship

    Fin Moorhouse, Toby Ord

    Finn Morehouse is launching two $100,000 prize pools to incentivize both critical analysis and promotion of Effective Altruism, aiming to establish robust feedback loops that prevent ideological ossification as the movement scales. He argues that the most effective path to maximizing global impact involves a "for-profit first" strategy, where individuals build substantial wealth before deploying it philanthropically to leverage the diminishing marginal utility of personal consumption. Complementing these financial initiatives, Morehouse advocates for "talent curation" and a "Long Reflection" to guide humanity away from catastrophic unilateral actions while navigating complex existential risks in space and artificial intelligence.

  7. 80,000 Hours1h 5m

    Toby Ord: "In which career can you make the most difference?"

    Toby Ord, Julian Savulescu

    Philosopher Toby Ord utilizes a counterfactual framework to argue that individuals should strategically design careers to maximize positive impact rather than relying on abstract moral reasoning. He distinguishes high-value roles, such as professional philanthropy and policy advocacy, from traditional paths by emphasizing replaceability and the specific difference an individual makes compared to alternative outcomes. Ord concludes that investing minimal time in career planning can multiply lifetime contributions by thousands of times, encouraging people to join communities like 80,000 Hours to pursue these opportunities.