newsfilter.io
Interview, Fireside Chat

The Powerful Alternative To Fine-Tuning

  • Predictions and Expectations:

    • Ian Fisher expects that AI models will continue to become "faster and easier" to use as time progresses.
    • Ian Fisher predicts that for startups using manual fine-tuning, the outcome will often be that they "go out of business" when newer frontier models are released.
    • Ian Fisher believes the S-curve for the Poetic system will keep "shifting higher and higher" as both the MetaSystem and underlying models improve.
    • Ian Fisher expects the industry will eventually "saturate or reach AGI, reach super intelligences" given the shifting S-curves.
    • Ian Fisher expects the Poetic MetaSystem to be the entity that "hits the ceiling first" rather than being limited by the underlying models.
    • Ian Fisher believes that for hard problems, the system can generate reasoning strategies written in code rather than just better prompts.
  • Timelines and Milestones:

    • Ian Fisher notes that his previous experience with GPT-5 was "eight months ago" (relative to the time of the interview).
    • Ian Fisher states the company first released results on the ARC AGI v2 benchmark "in December of last year."
    • The company plans to provide early access to startups that have tried everything but cannot solve "really hard problems" when they are "ready to work with you."
    • Ian Fisher mentions that the S-curve improvement is a continuous process where the gap between the user's solution and the frontier model's performance grows over time.
  • Technology and Product Direction:

    • Poetic is building a "recursively self-improving system" designed to make the AI "smarter" by generating systems that outperform the underlying language models.
    • The company plans to offer a service where they can "optimize that entire agent or pieces of that agent," including just prompts, reasoning strategies, or context stuffing.
    • The product direction involves creating a "harness" or "agentic system" that sits on top of one or more language models and remains compatible when new models are released without requiring user changes.
    • Poetic intends to automatically handle data understanding and failure mode identification, effectively outsourcing the need for humans to "know your data set really well."
  • Market and Industry Outlook:

    • Ian Fisher views frontier models (like those from Anthropic, OpenAI, and Google) not as competitors, but as the "foundational layer" or "stilts" that Poetic stands on.
    • Ian Fisher predicts that many startups currently fine-tuning models will face a situation where they "never catch up" because the frontier models they trained on are quickly surpassed by new releases.
    • Ian Fisher anticipates a paradigm shift similar to the move from pre-training to RL, stating that the current trajectory "rhymes a lot with RNNS" and represents a different paradigm than RL.
    • The industry outlook suggests a future where startups using Poetic can become as capable as the current SOTA (like Soda) by leveraging "stilts" that ensure they are always "taller" than the base model.
  • Company Plans:

    • Poetic plans to allow startups to sign up for early access via a button on poetic.ai once the company is ready to onboard customers.
    • The company is actively looking for problems that are "really hard" and where startups have "tried everything" but cannot achieve reliability.
    • Ian Fisher intends to continue doing "context engineering" in his spare time while running Poetic.
  • Financial Guidance:

    • Ian Fisher states that the optimization costs for the "Humanity's Last Exam" run were "less than 100K."
    • Ian Fisher projects that Poetic's approach is "half the cost" of competitors like Gemini 3 DeepThink on specific benchmarks (e.g., $32 per problem vs. $70-something).
    • Ian Fisher contrasts Poetic's costs with the "hundreds of millions of dollars" typically required for training runs by big foundation models.
  • Risks and Caveats:

    • Ian Fisher acknowledges that the underlying models (GPT-5-2, etc.) may "struggle to give you a reliable, robust result" on very hard problems without the Poetic harness.
    • There is a risk that without the Poetic system, startups will be "blown out of the water" by new model releases shortly after they complete their own fine-tuning.
    • Ian Fisher notes that the recursive self-improvement process may generate outputs (like prompts) that are "unexpected" or even "wrong" compared to human logic, which the company chooses not to manually correct immediately.
    • The speaker suggests that hardware robotics is "hard" and "more aspirational," implying a shift away from that path due to difficulty.
  • Confidence and Disagreement:

    • Ian Fisher states with high confidence that his system can generate reasoning systems that are "highly effective" and that they were "showing that we could get a lot higher than" the competition (Gemini 3 DeepThink) every single time.
    • Ian Fisher expresses certainty that they achieved a "9 percentage point improvement" on the official verification while being "half the cost."
    • Ian Fisher is confident in his advice that engineers should "just try things" and do "something with AI" every day.