newsfilter.io
Lecture

MIT AGI: Artificial General Intelligence

Course Mission and Philosophical Stance

  • Core Objective: The course (6S099) at MIT adopts an engineering perspective to "engineer intelligence," prioritizing the scientific construction of intelligent systems over speculative philosophical debates.
  • Methodology: The approach is defined by "mind in hand," grounding the exploration of fundamental intelligence concepts in the immediate creation of systems that function in the present day.
  • Contrast in Viewpoints: The curriculum explicitly opposes the "black box reasoning" view that focuses solely on the societal impact of a hypothetical human-level AGI (e.g., robot takeovers or utopia) without understanding the underlying mechanics.
  • Current Assessment of Capability: Instructors assert that current methods are far from achieving human-level intelligence, requiring a major leap, breakthrough, or paradigm shift.
  • Risk Assessment: While the course emphasizes engineering limits, it acknowledges the risk that exponential technological growth could lead to a "singularity" or sudden breakthrough that changes the landscape overnight.
  • Societal Impact Context: The course argues that safety, ethics, and future impact questions cannot be addressed constructively without a deep understanding of the actual methods and limitations of current AI systems.
  • Media vs. Engineering: A key educational goal is to avoid "futurism thinking" and hype detached from scientific understanding, contrasting media narratives (e.g., "AI created its own baby") with the engineering reality (e.g., a simple parameter grid search).

Key Challenges and Open Questions

  • The Fundamental Question: The central unresolved inquiry for the field is "How hard is it to create a human-level artificial intelligence system?"
  • Engineering vs. Biological Networks: Significant gaps exist between human brains (100 billion neurons, 100 trillion synapses, asynchronous, energy-efficient, unknown learning algorithms) and artificial networks (fewer synapses, limited topology, backpropagation-based, energy-intensive, trivial supervised learning).
  • Data Dependency: Current deep learning relies heavily on massive amounts of supervised data; the inability to learn efficiently without human annotation is a primary limitation.
  • Generalization Issues: Systems struggle with edge cases and transferring knowledge between domains, which is critical for real-world applications like autonomous vehicles operating in unpredictable environments.
  • Loss Function Flaws: Reward and loss functions are defined by humans and are often flawed when applied to real-world scenarios lacking a "ground truth" testing set (e.g., prioritizing speed over pedestrian safety).
  • End-to-End Learning: A major open challenge is determining if the entire AI stack—from raw sensory data to reasoning, knowledge formation, and physical action—can be learned end-to-end without distinct human-defined stages.

Course Projects

  • DreamVision: A competition utilizing Google Deep Dream concepts to generate video visualizations by mixing dream states with reality via neural networks; winners are judged on visual beauty via Mechanical Turk.
  • ANGEL (Artificial Neural Generator of Emotion and Language): An A/B testing project where agents generate emotion using a face with 26 muscles controlled by an LSTM network; the goal is to impress a viewer to choose the agent over a human or another agent.
  • Ethical Car: A deep reinforcement learning simulation extending the "Deep Traffic" competition by introducing stochastic, unpredictable pedestrians; participants must balance the goal of reaching a destination quickly against a loss function that penalizes harm to pedestrians (a Pareto front trade-off).
  • Vote AI: An aggregator platform where users submit links to AI articles and vote on their quality and sentiment (positive/negative) to explore arguments for and against AGI.

Scheduled Speakers and Key Themes

  • Josh Tenenbaum (MIT): Will discuss computational cognitive science, focusing on building "intuitive physics" and systems that can learn common sense rapidly (few-shot learning) via probabilistic generative models and symbol processing.
  • Ray Kurzweil (Google): Scheduled for Wednesday to discuss the exponential growth of intelligence, the definition of natural intelligence, and the future trajectory toward AGI.
  • Lisa Feldman Barrett (Northeastern University): Thursday speaker discussing the theory that emotions are "created" rather than innate, arguing that emotional intelligence is a learned societal norm that machines can be taught via machine learning.
  • Nate Derbinski: Will present on cognitive modeling architectures to systematically model the complexity of human cognition.
  • Andrej Karpathy (Tesla): Will address the limitations and possibilities of deep learning, specifically the power of representational learning (hierarchical feature extraction) and the contrast between biological and artificial neural network efficiency.
  • Stephen Wolfram: Monday evening session on knowledge-based programming (Wolfram Alpha), the use of cellular automata to show how simple rules generate complex patterns, and his experience analyzing alien language for the film Arrival.
  • Richard Moyes (Article 36): Will cover the legal and policy aspects of banning autonomous weapon systems and the safety hazards of machines making decisions to kill.
  • Mark Riber (Boston Dynamics): CEO of Boston Dynamics will discuss the engineering challenges of humanoid robotics and the societal perception of embodied intelligence.
  • Ilya Sutskever (OpenAI): Co-founder of OpenAI will discuss deep reinforcement learning in game playing (e.g., AlphaGo Zero self-play) and the feasibility of learning the entire AI stack from raw sensory data to action.

Future Course Direction

  • Expansion: The course will continue throughout 2018 with additional speakers and projects beyond the initial two-week intensive.
  • Bias and Ethics: Upcoming content will focus on creating AI systems that do not discriminate or inherit human social biases.
  • Creativity: Further exploration of using machine learning for art and music generation is planned.
  • Neuroscience Integration: A future gap to be filled is the inclusion of computational neuroscience and brain simulation perspectives.
  • Natural Language Processing (NLP): A dedicated speaker and project on NLP and the Turing Test are scheduled for March.
  • Community Engagement: Registered students are invited to join the "deep-MIT" Slack channel, submit five links, vote on ten articles, and participate in the three main competitions.