newsfilter.io
Interview, Fireside Chat

Nat Friedman Leads $15M in Superintelligence Insurance Company | AIUC

Sourcery with Molly O'SheaNat Friedman, Rune Kvist, Ben Mann, Molly
Watch on YouTube →

Company Launch & Funding

  • Runa's company (Sorcery) has officially emerged from stealth following a $14 million seed round.
  • Key investors include Nat Friedman (now on Meta's Superintelligence team), Emergence, and Terrain.
  • The fundraising process was rapid, converting an inbound term sheet into a closed deal within one week.
  • The founding team of four combines deep expertise in both insurance underwriting and AI technical standards.

Core Value Proposition: Certificates & Insurance

  • Sorcery addresses the industry's lack of knowledge regarding how AI agents fail and the absence of trust infrastructure for enterprise adoption.
  • The company offers a dual-layer solution:
    • Certification: An independent third-party audit against the "AI UC1" standard to verify risk mitigations.
    • Underwriting: Liability insurance that covers costs if the AI agent fails (e.g., hallucinating refunds, data leaks, discriminatory output).
  • The "AI UC1" standard is designed to update every three months to reflect rapidly evolving threat vectors and capabilities.
  • Unlike static standards like SOC2, AI UC1 specifically tests for AI risks including jailbreaks, hallucinations, and data training privacy.

Market Context & Historical Parallels

  • Sorcery positions itself as the insurance sector solution for AI, drawing parallels to Benjamin Franklin's 1752 fire insurance company and subsequent UL certifications for lightbulbs.
  • The model relies on a "incentive flywheel" where insurers pay for disasters, financially motivating them to enforce safety standards and audits before policies are issued.
  • Current enterprise adoption has shifted from "toy projects" and sandboxing to real-world deployments in banking and healthcare, though the majority of businesses still operate on paper.

Risk Landscape & Future Scenarios

  • The company identifies specific high-severity risks including:
    • Hallucinations: Agents providing false financial or medical advice.
    • Jailbreaking: Agents generating prohibited content (e.g., hate speech, Nazi propaganda).
    • Data Leakage: Agents inadvertently revealing other customers' sensitive data.
  • The "kill switch" concept is defined as a mechanism to prevent "loss of control" scenarios where agentic AI copies itself onto uncontrolled servers.
  • CalCham (prediction market) currently assigns a 5-8% probability to a catastrophic AI kill switch scenario occurring by the end of the year.

Strategic Positioning & Geopolitics

  • Sorcery proposes a "market-led" regulatory middle ground between voluntary industry commitments and slow-moving federal legislation.
  • The company warns that the EU AI Act's regulatory-first approach may hinder rapid adoption compared to market-driven standards.
  • A primary strategic goal is establishing American technical standards (AI UC1) to compete against potential Chinese standards in the global AI race.
  • The company anticipates a future where every AI agent requires certification and insurance, similar to mandatory vehicle insurance.

Team Background & Go-to-Market Strategy

  • Founder Runa was Anthropic's first product and go-to-market hire in early 2022, prior to the widespread commercialization of LLMs.
  • The GTM strategy initially targets "AI agent unicorns" (e.g., Cognition, Ada) that need to prove trust to Fortune 500 clients.
  • The company's primary success metric over the next six months is the volume of enterprises requesting their AI vendors to undergo AI UC1 certification.

Investor Dynamics

  • Nat Friedman provided critical advisory support, leveraging his experience with GitHub Copilot and Microsoft's IP insurance initiatives.
  • Investors are described as deeply integrated into the space, focusing on both technical buildout and high-level risk assessment.

Regulatory Environment

  • Federal AI regulation is projected to be unlikely within the current year, despite the existence of approximately 1,000 state-level bills.
  • Regulatory consensus suggests a divergence between "all gas, no brakes" voluntary approaches and top-down legislation, with Sorcery advocating for the latter to be supplemented by market mechanisms.