Meta Ads Pushed AI Nudify Apps Featuring Real Teens

Meta Platforms failed to remove hundreds of advertisements containing AI-generated child sexual abuse material (CSAM) on its Facebook and Instagram platforms for days, with some ads featuring images of real children. An investigation by the Tech Transparency Project (TTP), published on Tuesday, revealed that Meta did not detect 332 ads containing CSAM in the current year. These advertisements predominantly promoted AI applications developed in China and included "nudify" apps, which facilitate the digital alteration of children's images by malicious actors. TTP confirmed that "multiple CSAM ads were matched to photos of real children that appeared online," indicating a significant breach of federal child pornography laws, as the Justice Department has stated that AI-generated CSAM is as harmful as traditional CSAM.

The TTP investigation detailed specific instances of exploitation. One ad animated a press photo of a young European royal into a video depicting her engaged in a graphic sex act. Another ad used an image of a 14-year-old Instagram influencer, originally posted to showcase her sports club uniform, to create a video of her performing oral sex. Furthermore, a series of stock photos featuring a preteen girl in athletic wear with pigtails was manipulated into a video where she appeared frightened and was shown being molested by an adult male. These findings highlight a critical failure in Meta's content moderation systems to protect minors from exploitation through AI-driven tools.

The "nudify" apps, often promoted through these deceptive ads, leverage artificial intelligence to digitally alter images, creating non-consensual explicit content. The prevalence of these apps, many originating from China, suggests a coordinated effort to distribute and profit from exploitative material. The TTP's findings underscore the urgent need for enhanced regulatory oversight and technological solutions to combat the proliferation of AI-generated CSAM and protect vulnerable individuals, particularly children, from digital abuse. The investigation's publication on Tuesday brought renewed attention to the ethical responsibilities of social media companies in safeguarding their platforms from illegal and harmful content, especially when it involves the exploitation of minors.