San Francisco Demands Apple, Google Remove Nudification Apps

San Francisco's attorney general, David Chiu, issued cease-and-desist letters this week to Apple and Google, demanding the removal of 13 "nudification" applications from their respective app stores. These applications utilize artificial intelligence to alter images, enabling users to remove clothing, modify facial features, and place individuals in sexually explicit poses, or even superimpose victims' faces onto other people's naked bodies. Chiu's directive, reported by Wired, asserts that the app stores are in violation of California laws that prohibit the facilitation of services creating deepfake pornography.

The attorney general's office highlighted the potential for these AI tools to generate non-consensual explicit imagery, a practice that constitutes a severe form of abuse and exploitation. The letters specifically target applications that facilitate the creation of deepfake pornography, a growing concern for law enforcement and digital safety advocates. By ordering the removal of these apps, San Francisco aims to curb the proliferation of harmful AI-generated content and protect individuals from digital exploitation.

This action by San Francisco underscores the increasing regulatory scrutiny faced by major technology platforms regarding the content and applications available through their digital marketplaces. The demand places the onus on Apple and Google to actively police their app stores for AI-driven tools that can be misused for malicious purposes. The outcome of these cease-and-desist letters will likely influence future enforcement actions and platform policies concerning AI-powered content manipulation tools.