Ilge Akkaya

OpenAI's Noam Brown, Ilge Akkaya and Hunter Lightman on o1 and Teaching LLMs to Reason Better

Noam Brown, Ilge Akkaya, Hunter Lightman, Sonya Huang, Pat Grady

OpenAI's O1 model, internally codenamed Project Strawberry, introduces a paradigm shift by employing "inference time compute" to enable systems to engage in extended, self-correcting reasoning processes akin to human System 2 thinking. This architecture has delivered unprecedented capabilities in STEM domains, allowing the AI to solve complex Olympiad-level programming problems, pass research engineer interviews, and assist in scientific discovery by bridging the gap between difficulty in generation versus verification. While the project faces limitations in speed and creative tasks compared to predecessors like GPT-4, its demonstrated ability to scale performance through increased thinking time marks a significant advancement toward the operational goal of Artificial General Intelligence.