Interview
Nat Friedman (Github CEO) — Reading ancient scrolls, open source, & AI
The Vesuvius Challenge (Skrull Prize)
- Nat Friedman, co-founder of the Vesuvius Challenge (formerly Skrull Prize), has launched a competition to virtually unroll and read ancient papyrus scrolls from Herculaneum, Italy.
- The prize, funded alongside Daniel Gross, targets the first team or individual capable of extracting substantial, legible text from carbonized scrolls without physical unrolling.
- Current status involves over 600 intact scrolls that have remained sealed for roughly 2,000 years, with thousands more potentially buried in the Villa of the Papyri.
- Projected Impact: Successfully decoding these scrolls could approximately double the total volume of surviving text from antiquity, effectively adding "multiple Shakespeares" to historical records.
- Potential Discoveries: The villa likely contains a main library, possibly Latin-based, with texts predating the 1st century AD, including potential lost epic poems, historical records, or early Christian references.
- Technical Breakthroughs:
- Dr. Brent Seals (University of Kentucky) pioneered "virtual unwrapping" using 3D X-ray CT scans at 8-micron resolution.
- Recent advances utilize convolutional neural networks to identify ink traces within the papyrus layers, trained on ground truth data from broken-off fragments analyzed via infrared imaging.
- The team successfully identified ink signatures in fragments, proving the data is physically present in the scans, though scaling to full scrolls remains a geometric and computational challenge.
- Strategy: The open competition format aims to accelerate discovery by engaging a diverse global pool of experts, leveraging the "many eyes" hypothesis to solve the problem faster than a single grant-funded team could.
Archaeological Context and Challenges
- Discovery History: Herculaneum was buried under ~20 meters of volcanic mud in 79 AD; initial 1750s excavations by Swiss engineers utilized deep tunnels to recover treasure but destroyed many scrolls during attempts to physically unroll them.
- Material Properties: Papyrus scrolls were carbonized by heat and pressure, becoming extremely fragile, shriveled, and prone to disintegration upon contact with air or moisture.
- Ink Contrast Issue: Unlike the Dead Sea Scrolls, Herculaneum ink (charcoal-based) has low X-ray absorbance contrast against the carbonized papyrus, making ink segmentation significantly harder than previous successful attempts.
- Unexcavated Territory: Only about one-third of the Villa of the Papyri has been explored; two additional floors and a potential main library remain buried, waiting for excavation once reading techniques are proven.
Friedman's Philosophy on Inefficiency and Enthusiasm
- World Efficiency: Friedman explicitly rejects the "Efficient Market Hypothesis" applied to general societal problems, noting that many critical opportunities (e.g., housing policy, archaeological funding) remain unfilled simply because no one has yet seized them.
- Impulse to Action: He attributes his success to a low "activation energy" for new projects, driven by sustained enthusiasm rather than a calculated assessment of risk or existing market validation.
- Leverage Points: Friedman identifies high-leverage "cheap hacks" where small investments (e.g., the Vesuvius Challenge prize) can trigger massive downstream effects, such as funding for future archaeological digs.
GitHub Acquisition and Leadership
- The Deal: Friedman convinced Microsoft CEO Satya Nadella to acquire GitHub for $2 billion in 2018, arguing that developers were becoming the primary decision-makers in enterprise IT and Microsoft needed to regain developer trust.
- Leadership Strategy: To counter skepticism about Microsoft's acquisition, Friedman immediately instituted a "100 Days" sprint where the engineering team fixed one high-priority community-identified bug every day, prioritizing developer feedback over internal corporate strategy.
- Cultural Integration: Microsoft pledged its entire patent portfolio to open source post-acquisition, and GitHub retained significant operational independence, modeled after LinkedIn.
- Exit: Friedman departed in 2021, citing a desire to return to smaller, more nimble teams and the diminishing returns of navigating large corporate structures, despite his continued support for GitHub's mission.
GitHub Copilot Development
- Product Evolution: Early prototypes included chatbots and multi-option code synthesis, which failed due to low reliability and high cognitive load for users.
- Success Factor: The product became viable only after integrating heuristics to automatically switch between single-line completions and block-level synthesis based on cursor position, and optimizing for low latency with high accuracy.
- Adoption Metrics: Internal testing showed over 60% retention after 30 days, despite the tool's intrusive nature, proving strong product-market fit.
- Future Trajectory: Friedman predicts AI will eventually generate 95% of code, shifting software development toward highly specialized, custom-purpose applications rather than general-purpose tools.
AI Industry Trends and Economics
- Proliferation vs. Concentration: Friedman argues that the "proliferation" forces (commodity hardware, public data, transferable techniques) currently outweigh concentration forces, leading to a rapid spread of capable foundation models beyond major labs.
- Economic Impact: Text-to-text tasks currently represent low-double-digit percentages of the economy, but this is expected to grow significantly as costs drop and new use cases are discovered.
- Safety and Alignment: He advocates for the development of open-source technical alignment tools, criticizing the current lack of open implementation compared to the vast ecosystem of proprietary capability models.
- Incumbent Adaptation: Modern tech incumbents have learned to avoid disruption through early cannibalization and dedicated sales channels, and are aggressively adopting AI compared to previous platform shifts (e.g., mobile, cloud).
Philosophical and Cultural Observations
- Ceiling vs. Floor: Friedman argues that development should focus on "raising the ceiling" (innovating for the wealthy/rich first) to drive down costs via scale (e.g., cell phones in Africa) rather than attempting to directly "raise the floor" with specialized, often ineffective aid.
- Micromanagement: He contends that cultural prohibitions against micromanagement in professional settings can be harmful, arguing that empowering individuals with superior judgment to make decisions is often more valuable than consensus-driven processes.
- Open Source Governance: He notes that open source excels in infrastructure and horizontal components but struggles with user experience and design-heavy applications due to the high coordination costs and lack of "dictatorial" editorial control.
- Self-Perception: Despite his achievements, Friedman describes himself as an "insecure overachiever" who avoids nostalgia, preferring a forward-looking perspective and avoiding the accumulation of tangible trophies.