Geoffrey Irving

We have 3 years to solve alignment before superintelligence

Geoffrey Irving, Tom Reed

Researcher Toby Irving argues that the window to slow down superintelligence development has largely closed, necessitating coordinated pauses among fewer than ten global actors within the next two to three years. He contends that current alignment strategies face fundamental theoretical flaws, such as models winning debates through obfuscated arguments rather than truth, and advocates for a shift toward rigorous mathematical proofs and government-led defense measures. Irving's work at Resolution emphasizes celebrating negative evidence to identify phase shifts, while proposing that a post-ASI economy requires deliberate democratic oversight to prevent autonomous machines from operating against human interests.