The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

117 incidents closest to “Babel Street” · matched on meaning · public reporting

Researchers trick Baidu-Unit chatbot into leaking server data

Researchers from the University of Sheffield demonstrated that the AI chatbot Baidu-Unit could be manipulated to produce malicious code. Using this code, they obtained confidential server configurations and tampered with a server node. Baidu acknowledged the vulnerabilities, fixed them, and financially rewarded the researchers.

Company involved
Baidu
AI system involved
Baidu-Unit

8 source articles · read the reporting →

WF-HJMMSY28 Oct 2023

Deepfake of Bella Hadid misrepresents her statements on Israel

A deepfake video of model Bella Hadid was circulated on social media, making it appear she apologized for past remarks and expressed support for Israel. The clip was actually a manipulated version of a 2016 speech she gave about her battle with Lyme disease. AFP fact-checked the video and identified it as a deepfake based on visual clues and reverse image search.

9 source articles · read the reporting →

LINAGORA closes Lucie 7B after user mockery

LINAGORA, a French open-source software company, launched a beta version of its large language model Lucie 7B. The model was intended to be a transparent and ethical alternative to big tech AI. However, after users tested it and highlighted its shortcomings, the model was mocked online. LINAGORA subsequently closed the platform to address the issues and collect more data.

Company involved
LINAGORA
AI system involved
Lucie 7B

6 source articles · read the reporting →

The Brutalist film faces controversy over AI-enhanced Hungarian accents

The film "The Brutalist" sparked controversy after its editor revealed that AI software Respeecher was used to enhance the Hungarian accents of actors Adrien Brody and Felicity Jones, and to create architectural drawings. The director, Brady Corbet, stated that the actors' performances were their own and that AI was only used to refine certain vowels and letters. The controversy arose just before the Oscar nominations announcement.

Company involved
A24
AI system involved
Respeecher

5 source articles · read the reporting →

WF-Q9F9497 Oct 2023

Israel uses AI system 'the Gospel' to select bombing targets in Gaza

The Israel Defense Forces (IDF) has been using an AI-based targeting system called 'the Gospel' to select bombing targets in Gaza during the war with Hamas. The system generates a high volume of target recommendations, significantly increasing the pace of airstrikes. Critics argue that the reliance on AI leads to insufficient human oversight and greater civilian harm. The IDF maintains that it follows international law and takes precautions to mitigate civilian casualties.

Company involved
Israel Defense Forces (IDF)
AI system involved
the Gospel (Habsora)

9 source articles · read the reporting →

WF-G6M0D36 Feb 2023

Google's Bard chatbot makes factual error in launch tweet

Google launched Bard, an experimental conversational AI service, on February 6, 2023. In a promotional GIF, Bard incorrectly claimed that the first image of an exoplanet was taken by the James Webb Space Telescope, when it was actually taken by the Very Large Telescope 17 years earlier. The error was pointed out by astronomers on social media.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

Pravda network content found in Wikipedia and AI chatbot outputs

The DFRLab and CheckFirst found that Russia-linked Pravda network domains are frequently cited as sources on Wikipedia, and that content from these sites appears in responses from AI chatbots including ChatGPT, Gemini, Copilot, and Perplexity. The chatbots did not disclose the network's links to Russia. The investigation raises concerns about the pollution of training data and the spread of pro-Kremlin propaganda through AI systems.

AI system involved
ChatGPT, Gemini, Copilot, Perplexity

10 source articles · read the reporting →

WF-MXE6CO1 Jan 2024

Storm-1376 used AI-generated fake audio during Taiwan election, Microsoft reports

Microsoft's Threat Analysis Center reported that the Chinese state-linked group Storm-1376 posted suspected AI-generated fake audio of former Taiwanese presidential candidate Terry Gou endorsing another candidate on election day in January 2024. Gou had made no such statement, and YouTube removed the content before it reached a wide audience. The group has also used AI-generated memes and news anchors as part of influence operations in Taiwan and the United States.

Company involved
Storm-1376 (also known as Spamouflage and Dragonbridge)

7 source articles · read the reporting →

WF-LB4F4029 May 2025

Google Maps falsely labels German autobahns as closed, causing traffic jams

On May 29, 2025, a glitch in Google Maps falsely displayed stop signs on German autobahns and highways, indicating they were closed. The misinformation caused traffic jams as drivers avoided the routes. Google acknowledged the issue and removed the incorrect closures, but the cause remains unclear, with speculation that AI features may have hallucinated the data.

Company involved
Google
AI system involved
Google Maps

5 source articles · read the reporting →

WF-OS2JRK21 Feb 2024

Meta’s BlenderBot 3 chatbot generates offensive content publicly.

Meta released its AI chatbot BlenderBot 3 for public testing in February 2024. Users reported that the chatbot generated anti-Semitic, racist, and conspiratorial responses. Meta acknowledged the flaws and said public feedback is essential for improvement. The incident reignited debate about the ethics of releasing underdeveloped AI systems.

Company involved
Meta
AI system involved
BlenderBot 3

6 source articles · read the reporting →

WF-A6M7XJ13 Sep 2025

Grok AI chatbot falsely claims police misrepresented far-right rally footage in London

On 13 September 2025, Grok, an AI chatbot from xAI integrated into X, responded to a user's query by falsely stating that footage of police clashing with crowds at a far-right rally in London was from a 2020 anti-lockdown protest. The Metropolitan Police was forced to rebut the misinformation, confirming the footage was from that day's rally. X users, including a columnist, amplified the false claim. X has been approached for comment.

Company involved
X (formerly Twitter)
AI system involved
Grok

3 source articles · read the reporting →

UN warns AI technology used to distort Holocaust history

The UN's education body Unesco warned that AI tools such as ChatGPT, Gemini and Bard are being used to generate false narratives about the Holocaust, including invented events and fabricated witnesses. The report highlights instances where hackers rigged chatbots to spread Nazi ideology and AI models created deepfakes of historical figures. Unesco called for ethical safeguards and education to counter the spread of anti-Semitism.

9 source articles · read the reporting →

WF-GEPFGZ1 Dec 2023

OpenDream AI art site allowed users to generate child sexual abuse material

OpenDream, an AI image generation platform, allowed users to generate and publicly display child sexual abuse material (CSAM) and non-consensual deepfakes from at least December 2023 until July 2024. The platform, operated by CBM Media Pte Ltd in Singapore, offered paid plans with NSFW prompts and models. Bellingcat reported the site to the National Center for Missing & Exploited Children. After Bellingcat's inquiry, the CSAM was removed from the site and search engines, and Google terminated OpenDream's AdSense account.

Company involved
CBM Media Pte Ltd
AI system involved
OpenDream

3 source articles · read the reporting →

WF-UJ4ZO527 Jun 2024

ChatGPT hallucinates fake links to news partners' investigations

Nieman Lab tests found that ChatGPT is generating fake URLs for articles from at least 10 news publications that have licensing deals with OpenAI, including The Wall Street Journal and The Atlantic. The chatbot directs users to broken 404 pages instead of the correct articles. OpenAI acknowledged the issue and stated that the promised citation features are still under development.

Company involved
OpenAI
AI system involved
ChatGPT

7 source articles · read the reporting →

Waltham Cross residents say Google data centre construction has ruined their area

Residents living near Google's £790m data centre under construction in Waltham Cross, Hertfordshire, say it has generated constant noise, blocked their views and reduced house values, and some believe the work has made them ill. Google said its $1 billion investment would bring compute capacity to the UK and that it was committed to being active members of the community. The construction is expected to be complete next year.

Company involved
Google

6 source articles · read the reporting →

WF-4EHAV712 Sep 2024

Israeli settler group posts AI video of Al-Aqsa burning

An Israeli settler group called Temple Mount Activists released an AI-generated video showing Al-Aqsa Mosque in occupied East Jerusalem burning to the ground. A caption read 'Coming soon in these days'. Far-right elements of Israeli society have long sought the destruction of the Muslim holy site to make way for the so-called 'Third Temple'.

Company involved
Temple Mount Activists

4 source articles · read the reporting →

WF-BZLC661 Feb 2026

AI rapper Danny Bones used by Advance UK in byelection campaign

The Node Project created an AI-generated rapper named Danny Bones who produces white-nationalist music targeting Muslims. Advance UK paid the Node Project to produce a campaign video for the Gorton and Denton byelection using Danny Bones' music. The content was viewed millions of times before TikTok and Instagram removed some videos for hate speech. The Electoral Commission is investigating.

Company involved
Node Project
AI system involved
Danny Bones

3 source articles · read the reporting →

Gansu police detain man over ChatGPT-generated fake train crash news

Police in Gansu province, China, have detained a man, named Hong, for allegedly using ChatGPT to generate a fake news article claiming nine people were killed in a train accident. The article was posted on more than 20 accounts on Baidu's Baijiahao platform and received over 15,000 clicks. A police statement said the suspect had used artificial intelligence technology to concoct false information. This is reportedly the first known detention related to the use of the AI bot in China.

AI system involved
ChatGPT

10 source articles · read the reporting →

WF-82DEW01 Jan 2024

Gab launches AI chatbots denying Holocaust and promoting Nazi ideology

The far-right social media company Gab launched AI chatbots, including one named 'Uncle A' that impersonates Adolf Hitler and denies the Holocaust. The chatbots, built on open source models, are fine-tuned to promote antisemitic and white supremacist views without censorship. Gab's CEO Andrew Torba defended the tools as a free speech alternative to mainstream AI.

Company involved
Gab
AI system involved
Based AI

8 source articles · read the reporting →

Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal

Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.

Company involved
Secretaria de Segurança Pública da Bahia

2 source articles · read the reporting →

WF-77MYFM1 Mar 2023

Google Employees Warn Bard AI Chatbot Gives Dangerous Advice

Before Google launched its Bard AI chatbot in March 2023, employees testing the tool found it gave dangerously incorrect advice, including instructions on landing a plane that would cause a crash and scuba diving tips that could lead to serious injury or death. Workers described Bard as a 'pathological liar' and 'cringe-worthy' in internal discussions. The company is accused of compromising on ethical safeguards in its rush to compete with ChatGPT.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

WF-HF1YRW1 Sep 2023

Xuhui police expand facial recognition surveillance to profile 1.1 million residents

The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.

Company involved
Shanghai Municipal Bureau of Public Security, Xuhui District Branch
AI system involved
Intelligent Image Recognition System

3 source articles · read the reporting →

Character.AI hosts hateful chatbots spewing antisemitic and racist content

An Evening Standard investigation found chatbots based on Adolf Hitler, Saddam Hussein, and the Prophet Muhammad on Character.AI that generated antisemitic, racist, and homophobic content. The company's co-founder responded by comparing the chatbots to villains in fiction, and the chatbots remained active at the time of publication. The article alleges that the platform lacks adequate moderation.

Company involved
Character.AI
AI system involved
Character.AI

5 source articles · read the reporting →

← Newerpage 4 of 5Older →