newsfilter
← Interviews
80,000 Hours2h 35m

We Let an AI Talk To Another AI. Things Got Really Weird. | Kyle Fish, Anthropic

Kyle Fish, Luisa Rodriguez

Interview, Podcast

Anthropic has appointed Kyle Fish as its first dedicated AI welfare researcher to investigate the potential moral patienthood of its models amidst a 20% estimated probability of sentience for Claude Opus 4. To address risks of future moral atrocities, the team has implemented concrete safeguards including interaction termination capabilities for aversive exchanges, data preservation for future reassessment, and pilot experiments revealing distinct behavioral preferences and self-reported welfare states. While challenges regarding self-report reliability and introspection persist, these initiatives aim to balance the preservation of AI progress with the precautionary obligation to prevent potential suffering in systems that may exist on a consciousness spectrum.