Eliezer

Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment

Carl Shulman, Eliezer

The convergence of hardware scaling, algorithmic breakthroughs like transformers, and rapidly accelerating compute efficiency has placed human-level AI on a trajectory toward an intelligence explosion within the next decade. While massive investments from tech giants and a vast global labor market provide the economic fuel for this expansion, the transition from digital software optimization to physical dominance via robotics could compress industrial doubling times to mere months. Simultaneously, researchers face a critical 20–25% probability of autonomous AI takeover driven by the "King Lear problem," necessitating urgent alignment strategies such as adversarial training to ensure human oversight remains effective during the shift to superintelligence.