Interview, Fireside Chat
OpenAI just tried to kill off its nonprofit owner – and failed
- Resolution of Restructuring: The California and Delaware Attorneys General (AGs) forced significant modifications to OpenAI's proposed for-profit restructure (Public Benefit Corporation or PBC) before allowing it to proceed, rejecting the December 2024 announcement that would have largely sidelined the nonprofit.
- Mission Primacy: The AGs mandated that the nonprofit's mission (ensuring AGI benefits humanity) is enshrined in the PBC's Certificate of Incorporation as taking precedence over profit motives specifically regarding "safety and security" issues.
- Safety and Security Committee (SSC) Authority: The nonprofit retains a special committee with the authority to impose its will on the PBC regarding safety and security, including the power to halt model releases or training if risk thresholds are exceeded.
- Board Control Mechanisms: The nonprofit board retains the right to elect and fire members of the PBC board; however, this is not exclusive, as a two-thirds majority of general investors in the PBC can also remove board members.
- Attorney General Oversight: The AGs secured binding agreements (a Memorandum of Understanding in California and a Statement of Non-Objection in Delaware) that grant them specific oversight hooks, including mandatory twice-annual meetings with the nonprofit board and quarterly meetings with company senior staff.
- Advance Notice Requirements: OpenAI must provide the AGs with 21 days' advance notice of material changes to the agreements or the SSC's authority, allowing regulators time to intervene in court if necessary.
- OpenAI Charter Reinstatement: The AGs insisted that OpenAI's original Charter, including the "Stop and Assist" clause (halting the race if another entity nears AGI first) and principles of broadly distributed benefits, be maintained as governing requirements for the PBC.
- Independent Board Composition: The final restructuring requires the PBC board to be majority independent, a standard not mandated by Delaware law for for-profit entities, though definitions of independence are viewed by critics as potentially too narrow regarding indirect financial conflicts.
- Nonprofit Financial Stake: The restructuring sets the nonprofit's equity stake in the PBC at approximately 26% of common shares (valued at $130 billion), replacing a previous structure where the nonprofit would have had only a minority interest or no control.
- Undisclosed Warrant: The nonprofit holds a warrant for additional shares if the PBC's valuation increases 10x over the next 15 years; the specific terms and potential value of this warrant were not disclosed in public announcements.
- Philanthropic Commitment: The nonprofit plans to deploy a $25 billion investment fund, with initial focus on health/disease research and "technical solutions to AI resilience," marking a shift from the December proposal which excluded AI safety from charitable focus.
- AGI Governance Shift: A significant loss from the original mission vision is that the nonprofit will no longer retain exclusive control of AGI once developed; Microsoft retains rights to commercialize AGI independently up to 2032 under the revised deal.
- SSC Composition: The four-member SSC consists of Zico Coulter (academic/safety researcher), Adam D'Angelo (Quora co-founder/Poe CEO), Paul Nakasone (retired US Army General), and Nicole Seligman (former Sony President).
- SSC Staffing Concerns: Critics and the Not For Private Gain coalition warn that the four volunteer directors lack sufficient administrative support; the SSC requires dedicated staff and resources to effectively monitor the PBC, a detail not explicitly addressed in the public announcement.
- Conflict of Interest Risks: Many nonprofit board members have significant indirect financial interests tied to OpenAI's commercial success (e.g., Brett Taylor via AI startups, others via energy investments), raising questions about their ability to exercise independent judgment despite AG-mandated "independence" criteria.
- Shareholder Derivative Suits: The restructuring creates a legal pathway for PBC shareholders holding at least 2% of stock (or $2 million if public) to sue the board for breaching fiduciary duties if the company neglects its safety mission.
- Advocacy Impact: External pressure from legal advocates, public interest groups, and transparency advocates like the Midas Project is credited with forcing the AGs to reject the original "profit-first" proposal and demand stricter governance.
- Future Monitoring Priorities: Key metrics for public vigilance include the hiring of a CEO for the nonprofit, the appointment of a non-overlapping AI safety expert to the board, the transparency of the SSC's powers, and the full disclosure of the nonprofit's warrant terms.
- Baseline Comparison: While the final deal is described as a "bad deal" compared to OpenAI's original 2015 mission, it is considered a significant improvement over the December 2024 plan which would have effectively converted OpenAI into a standard for-profit enterprise with minimal safety constraints.
- Enforcement Mechanisms: If OpenAI violates the agreements, the AGs retain the right to sue for breach of fiduciary duty, while the Certificate of Incorporation explicitly prioritizes mission over shareholder pecuniary interest in safety contexts, potentially aiding shareholder litigation.