newsfilter.io

John Schulman

Showing 12 of 2 transcripts.

  1. Dwarkesh Patel7 min

    The inside story of how ChatGPT was built – OpenAI cofounder John Schulman

    John Schulman

    OpenAI developed ChatGPT by pivoting from standalone instruction-following models to a dedicated conversational architecture based on GPT-3.5 and later GPT-4 to better handle coding, clarifying questions, and factual limitations. The team resolved early reliability issues through hybrid training datasets that combined instruction following with chat-specific data, creating a system that intuitively defines helpfulness while acknowledging its own knowledge boundaries. This rigorous, multi-iteration refinement process established a specialized alignment framework that public fine-tuning APIs or simple interface wrappers cannot easily replicate.

  2. Dwarkesh Patel1h 36m

    John Schulman (OpenAI Cofounder) — Reasoning, RLHF, & plan for 2027 AGI

    John Schulman

    OpenAI projectors the evolution of AI from single-step coding tools to autonomous long-horizon agents capable of executing complex projects over days, with a potential emergence of artificial general intelligence within two to three years. This trajectory relies on shifting from imitation-based pre-training to reinforcement learning for multi-step coherence, while simultaneously deploying rigorous safety protocols like red-teaming and coordinated pauses to manage risks. Ultimately, these systems aim to integrate into global economies as collaborative partners that handle business automation, necessitating international regulatory frameworks to maintain human oversight and prevent a race to the bottom on safety standards.