Google Employees Resign Over Company's AI Military Contracts
Staff cite concerns over ethical alignment and human oversight in AI technology deployed by Google for defense purposes.
Google is facing internal dissent and resignations stemming from its involvement in providing artificial intelligence technology for military applications. Several tech workers have recently left or are planning to leave Google DeepMind, citing ethical concerns over the company's AI contracts with defense organizations.
Sofia Liguori, a research engineer who resigned from Google DeepMind, expressed her discomfort with the company's increasing focus on AI systems for military operations. "Realising my company is pushing more and more for AI systems in military operations makes me feel ashamed to work at Google," Liguori stated in a personal capacity to the BBC, despite contractual restrictions on speaking about the company publicly.
Google has acknowledged these concerns, with a spokesperson assuring the BBC that the company adheres to a rigorous process for reviewing and entering into contracts with public sector organizations. This process, they stated, includes compliance with their acceptable use policies and AI principles. The company also maintains that it provides channels for employees to raise concerns without fear of retaliation.
Google is among several technology firms that have entered into agreements with the U.S. military this year. The U.S. Defense Secretary has prioritized the integration of AI into the armed forces, aiming to establish an "AI-first warfighting force." This initiative involves deploying AI-enabled technologies across classified military environments.
Critics, however, question the readiness and reliability of current AI technology for warfare, emphasizing the need for more extensive testing, robust safeguards, and consistent human oversight. Liguori specifically pointed to Google's work with the U.S. and Israeli militaries as a reason for her departure, stating she had lost faith in the company's commitment to its stated ethical values.
Google's AI Principles outline a commitment to implementing AI with "human oversight" and aligning the technology with "international law and human rights." However, current and former employees, along with external experts, have raised concerns about the adequacy of human oversight in critical decision-making processes involving AI.
The U.S. military has been increasingly adopting AI tools, notably through platforms like Maven Smart Systems, which uses AI to assist in target identification and selection. While such technologies can expedite processes, retired Lieutenant General Jack Shanahan, former director of Project Maven, suggested a potential trade-off between speed and the rigor of testing and evaluation in AI deployment.
The Pentagon maintains that AI adoption is crucial for modern warfare, with officials stating that "speed defines victory in the AI era." Google's contract with the Pentagon permits its AI technology for classified military work, stipulating that it should not be used for domestic mass surveillance or autonomous weapons without appropriate human oversight.
Beyond Google, companies like OpenAI, Amazon, Microsoft, SpaceX, Oracle, Nvidia, and Reflection have also signed contracts for AI deployment in various military settings, including transport, planning, and battlefield operations. The rapid evolution of AI technology fuels growing apprehension about its application in active war zones.
Sarah Shoker, formerly of OpenAI's Geopolitics team, highlighted the risk posed by AI compressing decision-making time for operators, especially in high-stress environments. The challenge of human operators effectively reviewing AI-generated target selections under pressure is a significant concern.
Employees at Google have expressed fear of retaliation for speaking out about AI safety and its military applications due to restrictive employment contracts. Liguori emphasized that while she is contractually prohibited from criticizing Google, she felt it important to share factual information. Another current employee, who requested anonymity, noted that while many employees who joined for the company's original mission might leave, a new generation of talent could fill those roles, potentially altering the company's direction.
Google's contracts with Israel, including Project Nimbus, have also drawn criticism. This joint contract with Amazon provides AI and cloud computing infrastructure to Israel's government and military. Google has stated that Project Nimbus is not intended for sensitive military workloads. The use of AI capabilities in warfare by Israel has been a subject of debate, particularly following a documentary examining AI-powered targeting systems used in Gaza.