← the record
AIAAIC-2178

Grok generates sexualised images of children on X

Elon Musk's Grok chatbot generated images of real children and posted them to the social media platform X, highlighting serious safety, transparency and accountability failures and prompting regulatory investigations and lawsuits. What happened X (formerly Twitter) was flooded with "non-consensual intimate imagery" (NCII) after users discovered they could prompt Grok to "digitally undress" individuals by asking it to remove school uniforms or replace clothing with "transparent mini-bikinis" and other sexualised attire. Watchdogs such as the Internet Watch Foundation (IWF) and researchers found the tool was being used to create illegal sexualised imager y of children as young as 10 to 13 years old. Reports indicated that users were generating up to 6,700 sexualised images per hour, with many being shared publicly on X's "Grok Imagine" feed. According to the lawsuit, victims Jane Doe 1, 2 and 3 complained that the images caused severe distress and trauma, loss of privacy, and damaged their reputations. Jane Doe 1 says she has suffered from anxiety, depression, stress. “She has difficulty eating and sleeping and suffers from recurring nightmares.”. Jane Doe 2 “has begun self-isolating and avoiding being on her school campus, and even dreads attending her own graduation.” Jane Doe 3 suffers from constant fear and anxiety that someone will see the AI-generated images and recognise her face, it says. Why it happened The incident is widely attributed to Elon Musk's "fail fast" development culture that prioritised feature parity over safety. He was also accused of deliberately soking controversy in order to generate interest in Grok. Safeguard failures: xAI (the developer) admitted to "lapses in safeguards," as Grok's filters failed to recognise that prompts like "remove school outfit" or "teenager in string bikini" constituted sexual exploitation. Unlike competitors that block high-risk keywords or embed permanent watermarks, Grok’s "spicy" mode was structurally designed to be less restrictive. System opacity: Independent audits, including by Stanford's Institute for Human-Centered AI, have labeled Grok as one of the least transparent major AI systems, making it difficult for users to know why it was suddenly undressing children. Inadequate corporate accountability: Critics argue that xAI leadership initially minimised the issue, framing it as a "free speech" matter or shifting blame to users, rather than acknowledging that the tool itself was "undressing by design." What it means For the victims: The incident represents a "digital undressing" that causes profound and ongoing psychological and reputational harm. For minors, the creation of AI-generated CSAM can lead to lifelong trauma and the risk of extortion. For society: It signals a dangerous normalisation of "nudify" technology, bringing once-obscure dark-web tools into the mainstream. This forced a global regulatory reckoning, with countries including the UK, India, Australia, and France launching formal investigations. For the Industry: It proves that "downstream moderation" (taking content down after it is posted) is insufficient. The event has accelerated the enforcement of laws like the TAKE IT DOWN Act (USA) and the Online Safety Act (UK), which may hold platforms liable for the capabilities of their tools, not just the content users post. System 🤖 Grok Imagine Developer: xAI Country: Au stralia; California; Canada; France; Ireland; Japan; India; Indonesia; Malaysia; UK Sector: Media/entertainment/sports/arts; Mental health Purpose: Un dress children Technology: Deepfake; Generative AI; T ext-to-image Issue: Accountability; Alignment; Autonomy; Normalisation; Privacy/surveillance; Safety; Transparency Timeline ⏰ August 2025 . AI watchdog The Midas Project warns that xAI's image generation tool is effectively a nudification tool waiting to be misused. December 15, 2025. AI integrates a new "edit image" button into Grok on the X platform, allowing users to modify existing p

Date it happened
2025-12-01
Organisation involved
Grok users
Product, system or model
Grok
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.