Cults that want to kill everyone and stealth vs wildfire pandemics | Kevin Esvelt

The Escalating Risk of Deliberate Pandemics

• Scientific Incentives: Researchers face powerful career incentives to identify pandemic-capable viruses and publish findings on their potential to destroy civilization in top-tier journals (Nature, Science, Cell), with minimal counter-incentives to suppress this knowledge.
• Feasibility of Engineering: Experts project that humanity will inevitably learn to "program biology" to replicate any pathogen nature can create, including agents capable of killing billions and setting civilization back by a century.
• Democratization of Threat: The cost of synthetic DNA and the availability of "reverse genetics" protocols (assembly instructions from DNA/RNA to infectious virus) have dropped significantly, making pandemic-capable pathogens accessible to untrained actors.
• Accessible Pathogens:
  • Influenza: Approximately 125,000 professionals worldwide possess the skills to synthesize infectious influenza viruses; for some strains, only basic mammalian tissue culture skills are required.
  • Coronaviruses: The number of capable individuals is lower (single-digit thousands) due to the complexity of assembling larger genomes (>30,000 base pairs), but remains a significant risk.
  • Smallpox: Highly difficult to synthesize (186,000 base pairs) and requires a live pox virus host; access is likely limited to a few hundred experts, making it less of an immediate risk than influenza.
• AI and LLM Amplification: Large Language Models (like GPT-4) can teach non-scientists how to design, order, and synthesize dangerous pathogens in under an hour, including identifying non-screening DNA vendors and navigating contract research organizations to bypass detection.

Motivations for Malicious Actors

• Civilizational Collapse vs. Omnicide: Most malicious actors aim to collapse civilization rather than kill every human; this can be achieved by incapacitating essential workers (food, water, power, law enforcement) through high-lethality pathogens.
• Ideological Drivers:
  • Deep Ecology: Radical environmentalists may seek to eliminate humanity to allow nature to recover from the "sixth mass extinction."
  • Anti-Technology/Suffering Reduction: Groups like the Aum Shinrikyo cult or the Unabomber (Ted Kaczynski) believe technology and civilization degrade human happiness or cause excessive suffering, justifying the use of biological weapons to reset society.
  • Millenarianism: Cults like Aum Shinrikyo may view the apocalypse as a humane way to transition to a better world.

Two Catastrophic Scenarios

• The "Wildfire" Pandemic:
  • Definition: A pathogen with high transmissibility (R0 > 1) and high lethality that spreads so rapidly it incapacitates essential workers, causing societal collapse.
  • Thresholds: A pathogen with the transmissibility of measles (R0 ~15) and 30% lethality (similar to smallpox) could trigger this; even Omicron-level transmissibility could be fatal to essential workers if lethality is high enough.
  • Defense: Requires "Pandemic-Proof Personal Protective Equipment" (P4E) for all primary and secondary essential workers, plus improved ventilation (UVC lighting) in buildings.
• The "Stealth" Pandemic:
  • Definition: A pathogen with a long, asymptomatic latency period (e.g., respiratory HIV) that infects the global population before symptoms appear, followed by a delayed, high-catastrophe onset.
  • Detection Strategy: Requires metagenomic sequencing of wastewater (specifically airplane lavatory waste) to detect exponential growth of novel genetic signatures, even if specific engineering markers are absent.
  • Challenge: Convincing the public and defense establishments to act on genomic data before symptoms appear, requiring a network of "expert responders" and pre-briefed trust networks.

Technological Solutions and Defense Dominance

• Physical Defenses:
  • P4E: Advanced Powered Air Purifying Respirators (PAPRs) with HEPA filters can reduce infection risk by 10,000-fold; manufacturing costs could drop below $250/unit if scaled.
  • Germicidal Lighting: Far-UVC light (222 nm) is proven to sterilize aerosols without harming human skin; installation in buildings could be a market-driven solution to prevent airborne transmission.
  • Digital Risk Tools: Privacy-preserving apps could calculate individualized infection risk based on network proximity (contact tracing without personal data), allowing voluntary risk mitigation.
• Gene Drive Technology:
  • Defense Dominance: CRISPR-based gene drives are "defense dominant" because they are slow to spread, obvious to detect (CRISPR sequences in sexually reproducing organisms are unnatural), and reversible via "immunizing reversal drives."
  • Proposed Applications:
    • Malaria: Suppressing Anopheles mosquito populations to stop transmission.
    • New World Screwworm: Eradicating the fly to prevent animals and humans from being devoured alive, significantly reducing wild animal suffering.
    • Locusts: Disabling swarming behavior in desert locusts to prevent famine.
    • Lyme Disease: Engineering white-footed mice to be immune to the Lyme bacteria, interrupting transmission without pesticides.
  • Safety Protocols: Use of "daisy-chain" drives limits spread to localized areas for testing before potential scaling.

Future Outlook and Ethical Frameworks

• Offense vs. Defense: Biological "offense" (creating pathogens) is currently faster and easier than "defense" (countermeasures), but physics and engineering can eventually tilt the balance in favor of defense.
• The "Defense First" Principle: Inventors should prioritize developing defensive capabilities (vaccines, detection, physical barriers) before advancing offensive technologies (synthetic biology, pathogen engineering).
• Information Hazards: Open science poses a dual-use risk; releasing data on how to make pandemic agents helps both scientists and malicious actors, but withholding data prevents defense development.
• Social and Cultural Challenges: Successful implementation requires navigating "naturalness" heuristics, gaining community consent for ecological interventions, and overcoming political inertia.
• Optimistic Projection: Despite the risks, the host and guest conclude that humanity can solve these problems through investment in physical defenses, AI monitoring, and ethical technological deployment, allowing for a future of flourishing without the threat of self-annihilation.