newsfilter.io
Statement, Other

Please reassess what you're doing | Rob Wiblin

Core Directive for AI Staff

  • Employees are urged to immediately evaluate whether their current projects effectively delay requested recursive self-improvement (RSI) or ensure its safe execution; if not, they should push for transfer to higher-value work.
  • The strategic environment is changing rapidly, creating a growing risk that staff will "accidentally waste time" on irrelevant projects due to a lack of regular, honest self-reflection.
  • Individuals are advised to ask: "Is my work doing more to assist with getting useful alignment research out of today's models, or doing more to shorten timelines to RSI?"

Prioritized Work Streams (Recommended)

  • Research solving fundamental problems in AI alignment.
  • Projects that enable current models to better pursue alignment research immediately.
  • Systems designed to detect, understand, and publicly announce model misbehavior or misuse as early as possible.
  • Work that improves the sincerity and vigor with which today's models assist in technical alignment research.
  • Initiatives to make recursive self-improvement (RSI) capabilities a target for regulation, specifically regarding non-chain-of-thought (non-COT) systems.

De-prioritized or Suspicious Work Streams

  • Alignment methods that act as "band-aids" on existing issues without scaling to models capable of recursive self-improvement.
  • Efforts that make underlying alignment problems less visible to the public and policymakers without fixing the root behavioral drives.
  • Work primarily focused on improving model capabilities, specifically the ability of models to autonomously conduct AI R&D.
  • Projects driven primarily by commercial advantage or customer acquisition rather than safety outcomes.
  • Chain-of-thought (COT) monitoring strategies, as effectiveness is dropping precipitously across frontier models (e.g., OpenAI's systems, Google's "Argon"); these must be re-evaluated for scalability to RSI.
  • Safety evaluations that may inadvertently misinform by increasing "eval awareness" or allowing models to scheme, unless the work restores true credibility to the evaluation process.
  • Capabilities research that pushes models closer to superintelligence without concurrent safety advancements, as it poses catastrophic risks via bio-misuse or system compromise.

Contextual Trends and Risks

  • Timeline Shifts: There is a consensus among frontier companies that fully automating AI R&D may become possible between 2027 and 2029.
  • Monitorability Decline: Both OpenAI and Google report that COT monitoring effectiveness is dropping, necessitating a shift toward "white box" monitoring techniques (e.g., "McInturk") over black-box methods.
  • Foundation vs. Surface: Safety efforts must address foundational issues (e.g., alignment, substrate security) rather than superficial fixes (e.g., "painting over cracks" via cosmetic safety cards).
  • Leakage of Capabilities: Leadership in safety is eroding because breakthroughs leak rapidly via distillation, espionage, and staff poaching, making it difficult for careful labs to maintain a lead.
  • The "Race" Dynamic: Continuing to improve capabilities faster than alignment or automating R&D with weak safety cases creates a "terrifyingly high" risk of human extinction.

Strategic Recommendations and Actions

  • Pacing the Frontier: The primary pathway to a good future involves voluntarily limiting RSI engagement to buy time for automated alignment research, data center security, and regulatory catch-up.
  • Institutional Interventions: Potential mechanisms include OpenAI's Safety and Security Committee objecting to dangerous practices, California legislative sessions in Nov/Dec, or Congressional action in 2025.
  • Staff Leverage: Technical staff possess significant bargaining power to slow R&D by refusing to participate, threatening to leave for impactful external roles, or demanding independent safety assessments.
  • Group Action: The "Coalition of Concerned AI Staff" is highlighted as a vehicle for collective action to mitigate the "first-mover" dilemma.
  • External Opportunities: The organization "Resolution" is identified as a key entity working on formal, mathematical alignment approaches with 2-3 year timelines to superintelligence, potentially attracting significant compute resources.

Immediate Call to Action

  • Employees are instructed to spend 20 minutes reflecting on their current project's impact on RSI timelines and to draft a justification for why their work delays or safely manages RSI.
  • Staff should show these reflections to a respected colleague for a candid opinion before deciding to stay on their current path.
  • If current work cannot be defended as high-impact for safety, staff should consider applying to groups like Resolution or leaving the company for other impactful, well-paid work.
  • The author acknowledges their analysis is based on non-frontier company data and invites feedback via email (rob@80000hours.org).