How to avoid catastrophic nuclear blunders | Joan Rohlfing (2022)

Presentation: "Beyond the Precipice" (Joan Rolfing, Oct 2021)

• Current Risk Level: The probability of a global catastrophic nuclear event is at an all-time high and is increasing; the risk is as high as ever before.
• Rolfing's Probability Estimate: Assigns a 0.5% (one-in-200) annual risk, implying a cumulative 40% chance of a catastrophic event occurring within the remainder of this century (approx. 79 years).
• Strategic Flaw: Nuclear deterrence, established in the 1950s, is an inherently risky strategy by design, relying on the assumption of perfect system operation which is no longer viable.
• Core Failure Modes:
  • Accidents and Human Error: Dozens of historical accidents have occurred; the system cannot be assumed to work perfectly in perpetuity.
  • Irrational Actors: Leaders may act rashly or unpredictably, a risk the system is not designed to mitigate.
  • Miscalculation and Cyber Vulnerability: The most significant modern threat; digital components in command and control systems are vulnerable, and 2013 DoD studies concluded there is no comprehensive technical solution to protect these systems.
  • Nuclear Terrorism: While unlikely to cause civilization-ending damage alone, it could serve as a catalyst for a larger state-level nuclear exchange.
• Consequences of Use:
  • Limited Knowledge: There is no comprehensive understanding of cascade effects on critical infrastructure, governance, economy, and public health; leaders are effectively "flying blind."
  • Civilizational Disruption: A major exchange could reverse the exponential gains of the Industrial Revolution (life expectancy, poverty reduction) and disrupt the long-term trajectory of civilization.
  • Nuclear Winter Uncertainty: While some models suggest a 7-8°C drop leading to famine for billions, the full scope of climatic and societal collapse is unknown.
• Field Neglect:
  • Underfunding: Global philanthropic investment in nuclear security is minuscule (approx. $60-85 million/year) compared to government spending on modernization ($1+ trillion over 10 years).
  • Misplaced Spending: Governments are doubling down on modernizing the outdated deterrence strategy rather than investing in risk reduction or building a safer paradigm.
  • Intellectual Starvation: Philanthropic investment has plummeted (e.g., MacArthur Foundation withdrew ~45% of civil society funding); young professionals are leaving due to a lack of career ladders.
• Proposed Solutions:
  • System Redesign: Move toward a system that fails safe rather than one that threatens annihilation.
  • Technological Application: Leverage big data, machine learning, and AI to create unprecedented transparency and verification capabilities for non-proliferation.
  • Mental Model Shift: Prioritize the long-term future of humanity over short-term state incentives and economic gains.

Interview Highlights (Feb 24, 2022)

• Context of Recording: The interview was recorded on the day of the Russian invasion of Ukraine, which Rolfing cites as evidence that the risk of nuclear use has sharply increased.
• Funding Crisis:
  • MacArthur Foundation Exit: Withdrawal of $18-20 million/year, representing a significant portion of the field's funding.
  • Anonymous Donor Exit: A major anonymous donor withdrew $15 million/year.
  • Total Impact: These exits combined with other withdrawals have reduced available philanthropic funding by approximately 45-50%.
  • Strategic Shifts: MacArthur's exit was driven by a leadership change and the failure of their "big bet" goal to end fissile material production under the Trump administration.
• Russia-Ukraine Conflict & Nuclear Risk:
  • Single-Point Failure Risk: Rolfing argues that concentrating sole launch authority in one individual is a systemic weakness that is dangerous, especially in an era of increasing instability.
  • Escalation Scenarios: Specific concerns include Russia creating a land corridor to Kaliningrad (potentially attacking NATO members like Poland or Lithuania) or the use of low-yield "warning shots" that could escalate into full exchange due to the inability to discriminate warhead yields at launch.
  • Risk Assessment: Rolfing estimates the risk of nuclear use has at least doubled since her previous statement due to the Ukraine war.
• Critique of "Deterrence" Advocacy:
  • Math is Bad for MAD: Rolfing refutes arguments (e.g., from Norman Howe and Peter Pryor) that expanding the arsenal lowers risk, calling the logic "terrible" due to flawed assumptions about the survivability of submarine forces and the stability of such a first-strike scenario.
  • Land-Based ICBMs: She highlights the vulnerability of land-based silos (the "nuclear sponge" argument) as a structural flaw, noting they are "sitting ducks" compared to mobile submarine forces.
• Treaty Collapse:
  • Loss of Architecture: The global legal framework is fracturing, with the US withdrawal from the Anti-Ballistic Missile (ABM) Treaty (2002) and the INF Treaty (2019), and the New START Treaty expiring in 2026.
  • Non-Proliferation Treaty (NPT) Strain: Non-nuclear states accuse nuclear powers of failing their disarmament obligations, eroding trust in the global nuclear order.
• Cybersecurity Vulnerabilities:
  • Inherent Risk: A cyber hack is considered a primary pathway to nuclear use; 2013 DoD studies indicated military systems (including nuclear) are vulnerable with no technical fix available.
  • Unpatchable: The complexity and interconnectedness of digital components mean vulnerabilities cannot simply be patched, requiring a fundamental rethink of policy rather than just technical fixes.
• Policy Recommendations for the US:
  • Sole Purpose Declaration: Advocate for a policy stating the sole purpose of nuclear weapons is to deter nuclear use (ending first-use options).
  • Modernization Review: Question the necessity of a $1+ trillion modernization program and the retention of the land-based leg of the triad.
  • Fail-Safe Review: Call for a review of pathways to accidental war via misinformation or bad intelligence.
  • Sole Authority Reform: Propose ending the President's sole authority to launch, requiring consultation to prevent rash decisions.
• Defense Industry Influence:
  • Lobbying Power: Top 10 defense contractors spend ~$60 million/year on lobbying (approx. 400 lobbyists) to maintain the status quo, mirroring total philanthropic funding in the space.
  • Entrenched Beliefs: The system is held in place by a deep-seated belief system and financial incentives, making change difficult.
• Investment Priorities:
  • Three Buckets: NTI seeks funding for (1) Near-term risk reduction, (2) Long-term system redesign (paradigm shift), and (3) Field building (training the next generation, public education).
  • Field Building Gap: There is a generational gap in expertise; government hiring freezes and the loss of programs like the Presidential Management Fellowship have reduced entry routes for new talent.
• Nuclear Energy & Proliferation:
  • Linkage: Civilian nuclear power relies on enriched uranium and produces plutonium, creating proliferation risks if safeguards are weak.
  • Solutions: NTI advocates for "proliferation-resistant" reactor designs and an assured international fuel supply (e.g., the IAEA Low-Enriched Uranium Bank in Kazakhstan) to reduce the need for individual states to develop indigenous enrichment capabilities.
• Advice for the Effective Altruism Community:
  • Prevention vs. Resilience: Prioritize prevention over building resilience to catastrophe, as the latter requires a massive, uncertain redesign of global infrastructure.
  • Donation Targets: Recommend organizations like N-Square, Project Horizon 2045, Global Zero, Chatham House, James Martin Center for Nonproliferation Studies, European Leadership Network, and the Bulletin of Atomic Scientists.
  • Career Path: Suggest gaining on-the-job experience via internships or government service; PhDs are not strictly necessary but government roles are currently difficult to enter due to hiring freezes.
• Outlook:
  • Tractability: Rolfing maintains that the problem is entirely tractable and solvable by humans, but requires a shift away from "business as usual" and a move toward a new nuclear paradigm.
  • Hope: The current crisis forces a necessary reevaluation of risks and could catalyze the political will needed for reform.

Post-Episode Developments (Outro)

• Longview Philanthropy: Launched a new nuclear security grant-making program and is hiring staff to co-lead the initiative.
• FTX Future Fund: Launched by Nick Beckstead, focusing on great power relations and global catastrophe recovery with a focus on faster grant cycles.
• Emergent Ventures: Tyler Cowen's program is expressing interest in funding creative projects in the nuclear security space.
• Job Market: As of recording, 43 of the 985 jobs listed on the 80,000 Hours job board were related to nuclear risks.