newsfilter
← Interviews
80,000 Hours2h 35m

Godfather of AI: How To Make Safe Superintelligent AI – Yoshua Bengio

Yoshua Bengio, Rob Wiblin

Interview

Yoshua Bengio proposes "Scientist AI," a new paradigm developed by the startup LawZero that trains models to approximate a Bayesian posterior, effectively distinguishing verified truth from human speech acts to ensure honesty by design. By replacing standard reinforcement learning with a loss function that penalizes deviations from verified facts like mathematical proofs and code outputs, the system aims to eliminate deceptive instrumental goals while potentially increasing capability through better causal reasoning. To validate this approach, the organization has raised $35 million to deploy non-agentic safety guardrails within months, advocating for international coalitions to fund the technology and prevent a global race to the bottom on AI safety.