OpenAI Human Rights Lead Worries About Military AI Use

Sarah Yager assumed the newly created role of Human Rights and Responsible Deployment Lead at OpenAI in June, bringing 30 years of experience in military applications to the position. Her focus is on the ethical implications of artificial intelligence within military contexts, particularly given OpenAI's partnership with the Department of War (DoW). Speaking at the ScaleUp:AI conference in New York City, Yager articulated her significant concerns regarding the military's integration of AI, especially in relation to armed conflict. She stated, “This keeps me up at night: ‘What is the military going to do with AI when it comes to targeting? And what about autonomous weapons? And where is all of this going?'”

Globally, military forces are accelerating the adoption of AI technologies to develop advanced weaponry and autonomous systems, including drones and robotic platforms. Yager's position at OpenAI, a leading AI development company, provides her with an opportunity to address these complex ethical challenges from within the industry. She explained her motivation for taking the role, stating, “I have always wanted to go into places and persuade people where human rights was not necessarily the dominant idea.” She further described her current position as being "in the belly of the beast," a place she finds comfortable for her work in persuasion, discussion, and debate to influence outcomes.

OpenAI approached Yager for this leadership position shortly after securing a contract with the DoW in late February. This agreement involves deploying advanced AI systems within classified environments. The DoW contract followed a public disagreement between the DoW and another AI firm, Anthropic. Anthropic had sought to implement restrictions on its technology's use by the military, specifically prohibiting mass public surveillance and the development of fully autonomous weapons. The DoW did not agree to these stipulations, leading them to classify Anthropic as a supply chain risk. OpenAI subsequently entered into the contract, asserting that it had successfully negotiated similar guardrails with the DoW regarding the use of its AI systems, though the specifics of these guardrails remain undisclosed.

Yager's role is critical in navigating the intersection of cutting-edge AI development and the evolving landscape of global defense. Her background in military applications, combined with her commitment to human rights, positions her to advocate for responsible AI deployment in a sector where the stakes are exceptionally high. The rapid advancement of AI capabilities presents both unprecedented opportunities and profound risks, making the work of individuals like Yager increasingly vital in shaping the future of military technology and its impact on global security and human rights. The partnership between OpenAI and the DoW, valued at an undisclosed sum, underscores the significant interest and investment in AI for defense purposes.