Grok generates hyperrealistic racist images of football players
Elon Musk's AI chatbot, Grok, has been discovered to be generating photo realistic racist images of football players, raising concerns about its safety and potential online abuse and misinformation. What happened Signify, an organisation that works with prominent groups and clubs in sports to track and report online hate, said it has seen a sharp increase in reports of abuse since Grok strengthened its image generation capabilities in December 2024. Examples include an image depicting a Black player picking cotton; another shows the same player eating a banana surrounded by monkeys in a forest. Other images depict a number of players and managers meeting and conversing with controversial historical figures such as Adolf Hitler, Saddam Hussein and Osama bin Laden. England's Premier League is reportedly aware of the situation. It has established measures to report and combat racist abuse, which reportedly exceeded 1,500 reports in 2024. Why it happened The emergence of Grok-generated racist images can be attributed to several factors, notably the lack of effective safeguards. Unlike other AI tools that have stricter guidelines, Grok's system has many time sbeen shown to be easily manipulated or "jailbroken" by users to generate inappropriate images. What it means Athletes targeted by these images face not only personal harm but also broader implications for their mental health and public perception. The incident also highlights concerns that the normalisation of this kinds of imagery can contribute to a toxic environment in sports and beyond. Signify said it believes the introduction of photorealistic AI will make these kinds of outputs much more regular and visible. However, whether and how Elon Musk improves the safety of Grok remains unclear.
- Date it happened
- 2025-01-01
- Product, system or model
- Grok
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.