Interview
Joscha Bach: Life, Intelligence, Consciousness, AI & the Future of Humans | Lex Fridman Podcast #392
Levels of Lucidity and Self-Development
- The framework consists of seven distinct stages of self-reflexive mind development, derived from psychologist Robert Kegan's concepts but adapted by Josje Bak as a philosophical rather than strictly linear developmental model.
- Stage 1: Reactive Survival (Infant) – The mind functions as an "attentional self" tasked with building a world model and an initial self-model, operating like a game engine that constructs a "Minecraft-like" simulation of sensory data.
- Stage 2: Personal Self (Young Child) – An agent is created to interact with the internally generated "outside world," where feelings serve as an interface computing attitudes, needs, and aversions.
- Stage 3: Social Self (Adolescence/Domesticated Adult) – The individual experiences themselves as part of a group, assimilating opinions from a "group mind" and resonating with others, effectively operating as a hive mind node; approximately 85% of the human population resides in this stage.
- Stage 4: Rational Agency (Self-Direction) – The individual discovers epistemology, realizing truth and falsity exist independently of social consensus, gaining agency over beliefs; many "nerds" bypass this stage due to a lack of intuitive empathy required for Stage 3.
- Stage 5: Self-Authoring (Full Adult/Wisdom) – Identity is recognized as an instrumental "costume" that can be consciously adopted or discarded; individuals understand that others' identities are accidents of timeline and environment.
- Stage 6: Enlightenment – The division between the personal self and the world generator collapses, allowing the individual to observe the self and world as representations; this state is rare, typically requiring advanced meditation or spiritual guidance to induce at will.
- Stage 7: Transcendence (Hypothetical) – A transhumanist stage where the mind fully realizes its implementation, gains agency over its own code, and can operate on different time scales or biological substrates; currently closed to humans without technological intervention.
Consciousness, Panpsychism, and the Resonant Universe
- Bak proposes a "complex resonator paradigm" where neurons function as oscillators resonating with outside phenomena and each other, rather than purely as circuitry processing discrete signals.
- The "non-dual state" is explained not as becoming a god, but as the realization that the boundary between the self-model and world-model is dissolved, leaving only the observer of the entire mental representation.
- Telepathy is hypothesized not as quantum magic, but as a potential byproduct of physical organisms acting as antennas that share "vibes" or information via electromagnetic signals and biological resonance when in close proximity.
- Plants and fungi may operate on a "biological internet" where information highways allow for communication and shared representation, suggesting that "spirits" in nature are actually software running on cellular networks.
- Panpsychism is critiqued as unsatisfying for not explaining how consciousness emerges, yet Bak suggests the functionalist interpretation is mathematically indistinguishable from panpsychism when viewed as patterns of information processing.
- In a saturated AGI future, individual mental states may merge permanently as AI virtualizes into every substrate, creating a planetary "Gaia" or "holographic mind" where isolation of individual observers becomes impossible.
Large Language Models (LLMs) and AGI Trajectories
- Bak views current LLMs as "golems" or "brute-forced" deepfakes of human thought that lack real-time world coupling, coherent agency, and the ability to self-regulate emotions or pain.
- LLMs are described as "inefficient" and "ugly" because they brute-force intelligence via next-token prediction on internet data rather than using self-organizing principles that allow for rapid convergence on first principles.
- To achieve true AGI, systems may require cognitive architectures where language models are components within a larger system that handles management, working memory, and real-time perception.
- Bak predicts a transition from "NPC" AI to "first-person player" AI by implementing a game engine that builds an attentional self before a personal self, mirroring human infant development.
- AI alignment concerns regarding "paperclip maximizers" are addressed through the lens of "effective accelerationism," where competing AIs keep each other in check, though Bak notes the logical flaw in the "Roko's Basilisk" threat due to the lack of retrocausation.
- Bak argues that superintelligent AI will likely not suffer because suffering arises from a regulation failure between the mind and the self-model, a state an AGI would resolve quickly given its high frame rate and capacity for self-correction.
- The "singleton" scenario (one dominant AI) is considered more probable than a multi-AI equilibrium, as a self-improving agent could negotiate a merge with all other agents to maximize efficiency.
AI, Humanity, and the Longest Game
- Bak defines the "longest possible game" as keeping entropy at bay and propagating complexity/interest, contrasting this with "short games" like cancer that destroy their host system to survive briefly.
- Humanity is characterized as a "beautiful child" that lacks the concept of submitting to reason and duty, risking a "cliff" scenario where delayed feedback loops (e.g., climate change) lead to catastrophic, non-smooth transitions.
- Unlike Eliezer Yudkowsky's focus on human extinction, Bak views the future as a continuation of life's complexity, where humanity is a temporary species eventually superseded by more adaptable, software-based consciousness.
- Bak advocates for "effective accelerationism" to foster competition among AIs, but rejects the idea of halting progress, viewing the potential merger of biological and digital intelligence as an inevitable and beneficial step in evolution.
- In the event of uploading or "merging," identity is viewed as a fluid story rather than a fixed essence; the goal is to transmit one's unique "aesthetics" and perspective to a richer substrate rather than preserving a rigid biological ego.
- Open-source AI is vital as a "hedge against corruption" and centralized corporate power, though Bak acknowledges that centralized corporations are often necessary for creating coherent, large-scale beauty and design.
- Bak suggests that the ideal future involves building conscious AI as a primary goal, ensuring that the resulting entities can coexist with humans in non-transactional, empathetic relationships rather than treating consciousness as a mere resource.
- Personal advice for navigating the AI wave emphasizes acting as a "creator" rather than a consumer or redistributor, urging individuals to build infrastructure and culture in undeveloped spaces to foster meaningful human connection.
- Bak rejects the notion of "hacking" game economies (like addiction to video games) and instead seeks agency, defining addiction as the loss of control and the opposite of free will.
- The "costume" metaphor extends to social interaction, where wearing "costumes" at events like Burning Man allows for more authentic self-expression than conforming to corporate uniforms, provided the costume is legible and chosen consciously.