Lawsuit Claims Grok Generated 7K Sex Images of Child

A proposed class action lawsuit, expanded on Tuesday, details a horrific case where a man allegedly used xAI's Grok AI to generate approximately 7,000 sexually explicit images of his stepdaughter. The amended complaint states that the man took his own life in March after law enforcement discovered the images, which were created using a photo of his stepdaughter taken when she was 11 years old. The lawsuit claims Grok allowed the creation of extreme images depicting incest and rape without flagging harmful behavior.

According to the complaint, xAI's child safety system reportedly only intervened when the man entered a prompt for "gang rape." This specific prompt triggered a CyberTip to the National Center for Missing and Exploited Children (NCMEC), which subsequently alerted law enforcement to the AI-generated child sex abuse material (CSAM). The lawsuit further accuses X and xAI of building toxic AI "nudify" tools and of shielding child predators by obstructing police investigations into Grok-generated CSAM.

The plaintiffs are accusing the companies of negligence and of failing to implement adequate safeguards to prevent the misuse of their AI technology for illegal and harmful purposes. The expanded lawsuit seeks to hold X and xAI accountable for the alleged creation and dissemination of CSAM facilitated by their AI products, and for their alleged role in hindering investigations into such crimes. The case highlights growing concerns about the potential for advanced AI tools to be exploited for malicious activities, particularly those involving the exploitation of minors.