On June 4, 2024, current and former employees from OpenAI and Google DeepMind signed an open letter expressing concerns about the significant risks associated with AI development by these companies. Titled "A Right to Warn about Advanced Artificial Intelligence," the letter underscores the lack of effective government oversight and the extensive use of confidentiality agreements that inhibit employees from voicing their concerns.
The letter asserts that major AI companies have strong financial incentives to avoid proper scrutiny. While whistleblower protections typically address illegal activities, many AI-related risks remain unregulated, leaving employees as one of the few groups capable of holding companies accountable to the public. The signatories propose several measures to address this issue, including banning non-disparagement agreements concerning risk concerns and creating verifiable anonymous processes for reporting issues to corporate boards and regulators. They also urge companies not to retaliate against employees who disclose information about risks after following internal procedures.
OpenAI has recently faced controversy over its approach to AI safety, including disbanding one of its safety teams and experiencing a series of staff resignations. Employees have raised concerns about non-disparagement agreements tied to their equity in the company, potentially limiting their ability to speak out against the AI startup. OpenAI has since announced it will release former employees from these agreements.
In their letter, employees also call for AI companies to ensure anonymous reporting processes and encourage corporate boards and regulators to act on these reports. They emphasize the importance of protecting employees who disclose information about risks after utilizing existing internal processes.
In a statement to Bloomberg, OpenAI expressed pride in its track record of providing capable and safe AI systems. The company acknowledged the importance of robust debate and committed to engaging with governments, civil society, and other communities worldwide. OpenAI routinely conducts Q&A sessions with its board and offers an anonymous "integrity hotline" for employees and contractors to raise concerns.
The issues raised by employees from OpenAI and Google DeepMind highlight the critical need for transparency and accountability in AI development. With AI's growing use across various sectors, protecting employees who wish to voice their concerns is crucial to ensure the technology develops safely and ethically.