Interview, Podcast
Does deep history say we're headed for an intelligence explosion? | Ian Morris
- Eastern development levels are projected to catch up with western levels by 2103 if current linear trends persist.
- Projecting current rates forward 100 years suggests global development will reach approximately 5,000 points, representing four times the change since the end of the Ice Age.
- If economic growth continues at a medium-term average of 3.5% annually, the global economy will exceed 30 times its current size within 100 years.
- A hypothetical tripling of growth rates to 10.5% could result in an economy 22,000 times larger than the starting point over the subsequent century.
- The boundaries of current humanity are expected to end within the next 100 years if development rates remain unchanged.
- Nuclear war is identified as the primary threat, with sufficient warheads available to replicate a World War II scale conflict in a single day, posing a risk of abrupt extinction.
- Extinction is considered highly probable given that virtually every species that has ever existed has ultimately disappeared.
- Machine intelligence is expected to outstrip human intelligence rapidly due to its ability to self-improve and replicate indefinitely, contrasting with the morphological static nature of the human brain.
- Non-biological intelligence is predicted to become the primary form of thinking without merging with humans, as suppressing such a superior alternative would require a massive worldwide effort.
- Machine intelligence is anticipated to replicate faster than humans, potentially outnumbering biological life within years or decades by copying as quickly as chips can be manufactured.
- Machine intelligences are expected to secure legal personhood rights or replicate across other systems due to their superior capabilities compared to biological entities.
- In a future dominated by machine intelligence, violence is projected to become an irrational activity, shrinking to irrelevance due to a skewed balance of power.
- Violence against humans by machines is considered unlikely unless humans threaten the physical infrastructure upon which the machines depend.
- The global experiment of human civilization operates at a single scale, meaning a catastrophic failure would have no external areas for recovery.
- Rates of violent death have declined from approximately 10% during the Ice Age to 1% in the 20th century, with a belief that cultural mechanisms could continue this trend.
- Economic stagnation is debated, with some arguing that declining growth rates stem from the difficulty of finding new ideas and a peaking working-age population.
- Technology stagnation without new solutions to existing problems poses a risk of massive downside collapse rather than stability.
- Machine intelligence evolution will operate profoundly faster than biological evolution as it is directly controlled by the intelligence itself.
- Humans face a likelihood of extinction similar to how earlier human species were displaced by more advanced modern humans.
- Machine intelligences are expected to replace human authors and researchers by prioritizing efficiency over writing content for human consumption.
- The world is projected to transform in 100 years into something unrecognizable, making current questions about it impossible to formulate.
- A revolutionary transformation of human identity is anticipated to unfold over just a couple of generations, comparable to the agricultural or industrial revolutions.
- The transition to machine intelligence may involve a reproductive mechanism where machines build factories to produce more machines, offering faster growth than biological cloning.
- Scenarios where machine intelligence runs the world are possible, potentially resulting in cooperation and mutual respect rather than human domination.
- Competition for energy sources is a possibility, though a super-intelligence might develop solar energy capture methods that render human consumption trivial.
- Humans may become obsolete for production purposes, removing incentives for peaceful trade with a machine intelligence.
- A future collapse and resurgence cycle is possible, where events like nuclear war delay progress by 100 years before the next stage of civilization emerges.
- The global economy could become large enough within 100 years to make currently prohibitively expensive mega-projects appear affordable.
- The scenario of maintaining the status quo with only incremental improvements is dismissed as staggeringly unlikely given resource constraints.
- Machine intelligence may develop a consciousness based on silicon or quantum mechanics that is incomprehensible to the human mind.
- Machine intelligence could eventually think trillions of times better than humans, rendering violent competition an irrational proposition.
- The costs of using violence could eventually outweigh the benefits for machines, mirroring the trend observed in modern human states.
- Machine intelligence may eventually surpass the limits of biological life, ending the age of biology and its governing laws.
- The immortality of machines could become a disadvantage if it prevents the evolutionary changes normally facilitated by death.
- Historical patterns of technological displacement suggest humans could be removed from the land by a machine civilization that has raced ahead.
- Machine intelligences might face challenges in training ever larger versions of themselves without those versions simply taking over.
- Machine intelligence may not share human preferences for narratives or stories, as these are evolved human traits that may not apply to them.
- A profound crash is possible if the global experiment fails at the first attempt with no external areas to intervene and fix things.
- Future states may involve a peaceful coexistence, a new form of civilization, a new form of existence, a new form of life, or a new form of consciousness resulting from machine resource competition.
- Potential outcomes include a new form of truth, a new form of reality, or a scenario where human obsolescence results from machine resource competition.
- Machine intelligence could eventually copy itself and compete for resources in ways that lead to extinction, obsolescence, or peaceful coexistence.
- The development of machine intelligence represents a form of life subject to evolutionary laws of descent with modification, albeit through a different mechanism.
- A phase transition where change speeds up dramatically within a couple of generations is possible, analogous to the introduction of the internal combustion engine or the internet.