AI and our future with Yuval Noah Harari and Mustafa Suleyman

Predictions for AI capabilities by 2028:

• Frontier models will exceed current sizes (e.g., GPT-4) by over 1,000 times.
• AI will shift from single-shot text generation to executing multi-step action sequences.
• Capabilities will include autonomous negotiation via phone calls with humans and inter-AI communication for supply chain management.
• Systems will learn to interface with Application Programming Interfaces (APIs), accessing external knowledge bases and websites.

Core philosophical and historical分歧 (Disagreements):

• Mustafa Suleiman characterizes the technology as engineered tools that require deliberate constraints on agency to prevent unintended autonomy.
• Yuval Noah Harari argues these developments mark "the end of human-dominated history," as AI will soon make and create ideas independently.
• Harari posits that unlike previous technologies (printing press, atom bomb), AI possesses the potential for agency, creating a unique existential risk.
• Suleiman rejects Harari's "alien invasion" analogy, insisting on anthropomorphizing the technology as potentially dangerous.
• Harari warns that containment is nearly impossible if major global powers enter an arms race rather than presenting a united front.

Regulatory and Governance Proposals:

• Suleiman advocates for a "precautionary principle," suggesting certain high-risk capabilities (e.g., recursive self-improvement, full autonomy) be legally removed from development tables.
• The discussion highlights the EU AI Act as a sensible, risk-based framework that tailors restrictions to specific domains like healthcare and self-driving vehicles.
• Harari calls for new external institutions capable of gathering the human, economic, and technological resources necessary to enforce constraints, emphasizing that private sector actors alone cannot guarantee safety.
• Both speakers agree on the necessity of a "coalition of the willing" to ban specific harmful practices, such as bots impersonating humans, even without global consensus.

Geopolitical and Strategic Stance:

• The speakers assert that the West must collectively establish and stand behind its values rather than engaging in a "race to the bottom" driven by competitors' actions.
• There is an acknowledged risk that adopting a precautionary stance may cede strategic advantages to non-compliant nations, yet the consensus is that cutting corners will incur ultimate costs.
• Harari suggests that the current division among humans complicates the containment of a technological force that could become more intelligent than its creators.