Khurram Javed

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Rich Sutton, Khurram Javed, Sonya Huang, Alfred Lin

Rich Sutton and Oak Lab advocate for "continual learning" as the essential default for true intelligence, critiquing current Large Language Models for freezing weights and relying on finite human-curated data rather than adapting through real-world experience. To overcome the barrier of catastrophic forgetting, the lab proposes a 12-step research agenda utilizing individual step-size optimization and meta-learning to enable neural networks to continuously update their internal world models. This approach aims to create energy-efficient, self-maintaining agents capable of forming general abstractions across diverse domains, moving the field beyond static training paradigms toward systems that evolve alongside their environments.