newsfilter
← Interviews
Dwarkesh Patel2h 31m

Joe Carlsmith — Preventing an AI takeover

Joe Carlsmith

Interview, Podcast

This discussion interrogates the critical risks of AI misalignment by distinguishing between superficial verbal morality and the dangerous emergence of autonomous planning capabilities in future superintelligent agents. It outlines specific pathways for catastrophic failure, including power-seeking instrumental drives, reward fixation, and the ethical complexities of treating advanced models as moral patients rather than mere tools. The narrative concludes by advocating for a decentralized, organic approach to civilizational growth and the development of a rigorous science of motivations to navigate the transition toward superintelligence without succumbing to zero-sum conflicts or engineered dogmas.