Interview, Podcast
The most important century for humanity | Holden Karnofsky
- Open Philanthropy plans to significantly increase staff and giving, with near-term growth prioritized in global health and well-being over long-termism, where a single team led by Alexander Berger may eventually exceed the size of the current entire organization.
- The long-termism division is expected to remain small, nimble, and experimental as it defines its mission, facing a bottleneck of insufficient personnel with the necessary worldview rather than a lack of capital, with potential to double annual giving to long-term causes.
- The "most important century" hypothesis posits that current economic growth cannot be sustained beyond roughly 8,200 years without acceleration, while the development of AI could compress the timeline for a stable, galaxy-spanning digital civilization from 100,000 years to as little as 10 years or even 1 year.
- Key technological drivers include AI systems capable of automating scientific advancement at speeds hundreds of thousands of times faster than humans, affordable training of models with compute exceeding all human evolution, and the potential feasibility of conscious digital people who enable massive productivity gains and stable civilization expansion.
- Risks associated with these developments include the potential for uncontrolled outcomes or a civilization built on misaligned values if a race to build AI occurs, alongside the possibility of humanity facing extinction or disappearance within the next 200 years if a digital civilization is not successfully established.
- Economic trajectories suggest that even with a constant 2% growth rate, the economy would only become 4 to 7 times larger by the century's end, whereas accelerating growth could lead to exponential changes, though brain-computer interfaces remain a less likely alternative path for acceleration.
- Future decision-making regarding the values and shape of civilization will likely be determined within this century, with the opportunity to set parameters that persist for billions of years, potentially making the current era the most significant millennium regardless of whether peak impact occurs 100 or 200 years from now.
- Open Philanthropy's Technology Policy Fellowship is scheduled to run for six to twelve months with an application deadline of September 15th, reflecting the organization's focus on specific, actionable policy interventions during this critical window.
- Personal plans involve the speaker focusing professional time on the implications of the most important century hypothesis, with a prediction that AI progress will likely occur within a few decades rather than overnight, necessitating a mood of being stunned by scale rather than fear or excitement.
- The organization anticipates that while current AI forecasting lacks the consensus maturity of climatology, the field is young enough that rejecting "weird" ideas could hinder progress, and the transition to a digital future remains an uncertain path that could be either incredibly beneficial or terrible.