#6 - Dr Toby Ord on why the long-term future matters more than anything else & what to do about it

Core Thesis: The survival of humanity and the preservation of a positive long-term future is the most critical issue of our time, representing an irrevocable loss if extinguished.

• Current human civilization has lasted approximately 10,000 years, yet the species has existed for 200,000 years and could potentially persist for up to 500 million to 1 billion years if risks are managed.
• Technological power has accelerated exponentially (Scientific Revolution, Industrial Revolution), outpacing the growth of civilizational wisdom and coordination, creating a unique "pivotal" era where extinction is possible within a single century.

Scale of Stakes: The value of the future is driven by duration and scope, not merely current population size.

• A single generation risking extinction is comparable to risking one's entire life to satisfy a minor desire in a single minute.
• The potential scope of humanity includes colonization of the galaxy (100 billion stars), vastly increasing the magnitude of lost value compared to just a billion years of Earth-bound existence.
• Extinction would end the partnership of generations, breaking a legacy built by ancestors and depriving future beings of the opportunity for achievement, wisdom, and flourishing.

Key Existential Risks: The primary threats are anthropogenic (human-caused) rather than natural, as natural extinction events are statistically rare (hazard rate likely below 1 in 2,000 per century).

• Artificial Intelligence (AI): Identified as the most significant specific threat, potentially being the most powerful technology of the century with high downside risks.
• Synthetic Biology: Poses a risk of accidental or deliberate engineered viruses capable of causing extinction or ecosystem collapse.
• Great Power War: While not extinction alone, the likelihood of nuclear war (estimates range from 10% higher during Cold War crises to a 1 in 6 chance for the current century) drastically increases existential risk.
• Unknown Unknowns: A significant portion of future risk will likely stem from technologies or scenarios currently unimagined.

Philosophical Framework (Long-Termism): The view that people matter equally regardless of when they exist, leading to high leverage for current actions.

• Person-Affecting View Objection: Refuted as logically inconsistent; even proponents must care about "merely possible" people to avoid creating lives worth less than non-existence.
• Discount Rates: Economists often apply a "pure rate of time preference" (impatience), but philosophers argue this is irrational for moral reasoning; the only valid discount rate for the future is the probability of extinction.
  • A 1% pure time preference implies the welfare of Tutankhamen was more valuable than all 7 billion living people today.
• Optimism about Future Quality: Conditional on survival and the acquisition of wisdom, the future is expected to be net positive, with better treatment of animals and environments compared to the present.

Practical Implications and Strategy:

• Targeted vs. Broad Interventions: Direct work on specific risks (e.g., AI safety, nuclear non-proliferation) is generally more effective than broad societal improvement, though broad efforts (wisdom, coordination) are necessary foundations.
• Individual Agency: While individual impact seems small, historical near-misses (e.g., Stanislav Petrov, Vassily Arkhipov, John F. Kennedy) demonstrate that single individuals can prevent global catastrophe.
• Career Strategy: Individuals can position themselves in roles involving science policy, technical safety research, and international diplomacy to influence outcomes at critical junctures.
• Neglectedness: Global existential risk is under-prioritized because it is a "global public good" where individual nations internalize only a fraction of the costs/benefits, leading to market failure.

Strategic Goals:

• Safe Position: The goal is to move humanity to a state of prudence and coordination where risks are managed safely, rather than relying on "backup plans" like Mars colonization which are cost-ineffective and vulnerable to correlated risks (e.g., war, ideology).
• Institutional Reform: Leveraging periods of political appetite (like post-WWII) to establish new global institutions that facilitate international coordination and prevent catastrophic war.
• Moral Uncertainty: Even if one is agnostic about the value of the future, the "option value" of preserving humanity allows for future information gathering; extinction permanently removes the ability to learn whether the future is worth saving.

Quantitative Estimates:

• Toby Ord estimates the risk of human extinction (or civilizational collapse) in the 21st century at approximately 1 in 6 (similar to Russian roulette).
• He argues that even if risks are lower (e.g., 1 in a million per century), the potential duration of the future (millions of centuries) makes avoiding that risk disproportionately valuable.

Future Outlook:

• Despite the 1-in-6 risk, the outlook is "half full" because survival is more likely than not if humanity rises to the challenge.
• Success would lead to a glorious future of interstellar expansion and the realization of humanity's unique potential as the universe's means of self-understanding.
• Failure to act now risks becoming the "worst generation" for squandering a billion-year legacy of potential over a short-term gain.