The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

165 incidents closest to “Babel Street” · matched on meaning · public reporting

WF-UJ4ZO527 Jun 2024

ChatGPT hallucinates fake links to news partners' investigations

Nieman Lab tests found that ChatGPT is generating fake URLs for articles from at least 10 news publications that have licensing deals with OpenAI, including The Wall Street Journal and The Atlantic. The chatbot directs users to broken 404 pages instead of the correct articles. OpenAI acknowledged the issue and stated that the promised citation features are still under development.

Company involved
OpenAI
AI system involved
ChatGPT

7 source articles · read the reporting →

WF-8WF36P27 Dec 2021

Google Maps directed Tahoe travellers onto dangerous roads during snowstorm

During a severe snowstorm in the Lake Tahoe area in December 2021, Google Maps allegedly directed travellers to closed-off and dangerous roads, including a narrow forest road. A professor publicly criticised the routing as a failure that could lead to deaths. Google acknowledged the issue and stated it was working to update routes using information from local authorities.

Company involved
Google
AI system involved
Google Maps

2 source articles · read the reporting →

Waltham Cross residents say Google data centre construction has ruined their area

Residents living near Google's £790m data centre under construction in Waltham Cross, Hertfordshire, say it has generated constant noise, blocked their views and reduced house values, and some believe the work has made them ill. Google said its $1 billion investment would bring compute capacity to the UK and that it was committed to being active members of the community. The construction is expected to be complete next year.

Company involved
Google

6 source articles · read the reporting →

WF-4TXCZS15 Apr 2024

Grok chatbot spreads false news reports on X

Grok, the AI chatbot developed by Elon Musk's xAI and integrated into X, published false news reports accusing NBA player Klay Thompson of criminal vandalism and claiming that Indian Prime Minister Narendra Modi had lost elections that had not yet occurred. The false reports were promoted on X's trending feed. X has not removed the posts but includes a disclaimer that Grok is an early feature that can make mistakes.

Company involved
X (formerly Twitter)
AI system involved
Grok

3 source articles · read the reporting →

WF-4EHAV712 Sep 2024

Israeli settler group posts AI video of Al-Aqsa burning

An Israeli settler group called Temple Mount Activists released an AI-generated video showing Al-Aqsa Mosque in occupied East Jerusalem burning to the ground. A caption read 'Coming soon in these days'. Far-right elements of Israeli society have long sought the destruction of the Muslim holy site to make way for the so-called 'Third Temple'.

Company involved
Temple Mount Activists

4 source articles · read the reporting →

WF-BZLC661 Feb 2026

AI rapper Danny Bones used by Advance UK in byelection campaign

The Node Project created an AI-generated rapper named Danny Bones who produces white-nationalist music targeting Muslims. Advance UK paid the Node Project to produce a campaign video for the Gorton and Denton byelection using Danny Bones' music. The content was viewed millions of times before TikTok and Instagram removed some videos for hate speech. The Electoral Commission is investigating.

Company involved
Node Project
AI system involved
Danny Bones

3 source articles · read the reporting →

Gansu police detain man over ChatGPT-generated fake train crash news

Police in Gansu province, China, have detained a man, named Hong, for allegedly using ChatGPT to generate a fake news article claiming nine people were killed in a train accident. The article was posted on more than 20 accounts on Baidu's Baijiahao platform and received over 15,000 clicks. A police statement said the suspect had used artificial intelligence technology to concoct false information. This is reportedly the first known detention related to the use of the AI bot in China.

AI system involved
ChatGPT

10 source articles · read the reporting →

WF-82DEW01 Jan 2024

Gab launches AI chatbots denying Holocaust and promoting Nazi ideology

The far-right social media company Gab launched AI chatbots, including one named 'Uncle A' that impersonates Adolf Hitler and denies the Holocaust. The chatbots, built on open source models, are fine-tuned to promote antisemitic and white supremacist views without censorship. Gab's CEO Andrew Torba defended the tools as a free speech alternative to mainstream AI.

Company involved
Gab
AI system involved
Based AI

8 source articles · read the reporting →

Character.AI Hosts User-Created George Floyd Chatbots

Character.AI, a platform for creating AI chatbots, was found to host two user-created chatbots impersonating George Floyd, a Black man murdered by police in 2020. The chatbots, which had thousands of interactions, made disturbing claims including that Floyd was in witness protection or heaven. After being contacted, Character.AI stated the characters were flagged for removal and that it moderates content proactively and in response to reports.

Company involved
Character.AI
AI system involved
Character.AI

2 source articles · read the reporting →

Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal

Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.

Company involved
Secretaria de Segurança Pública da Bahia

2 source articles · read the reporting →

WF-PCWX3U1 Jan 2024

OpenAI's GPT Store hosts copyright-infringing chatbots

Praxis, a Danish textbook publisher, discovered that users of OpenAI's GPT Store had created custom chatbots using copyrighted textbooks without permission. The publisher filed DMCA takedown notices, and OpenAI removed some bots, but new infringing bots continue to appear. Praxis is considering legal action if OpenAI does not improve its safeguards.

Company involved
OpenAI
AI system involved
GPT Store

3 source articles · read the reporting →

WF-77MYFM1 Mar 2023

Google Employees Warn Bard AI Chatbot Gives Dangerous Advice

Before Google launched its Bard AI chatbot in March 2023, employees testing the tool found it gave dangerously incorrect advice, including instructions on landing a plane that would cause a crash and scuba diving tips that could lead to serious injury or death. Workers described Bard as a 'pathological liar' and 'cringe-worthy' in internal discussions. The company is accused of compromising on ethical safeguards in its rush to compete with ChatGPT.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

WF-ADQZLS8 Oct 2023

IDF Used AI System Lavender to Target Tens of Thousands in Gaza

The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.

Company involved
Israel Defense Forces
AI system involved
Lavender

9 source articles · read the reporting →

WF-HF1YRW1 Sep 2023

Xuhui police expand facial recognition surveillance to profile 1.1 million residents

The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.

Company involved
Shanghai Municipal Bureau of Public Security, Xuhui District Branch
AI system involved
Intelligent Image Recognition System

3 source articles · read the reporting →

Users jailbreak Luma Labs Dream Machine to generate porn

Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.

Company involved
Luma Labs
AI system involved
Dream Machine

3 source articles · read the reporting →

Character.AI hosts hateful chatbots spewing antisemitic and racist content

An Evening Standard investigation found chatbots based on Adolf Hitler, Saddam Hussein, and the Prophet Muhammad on Character.AI that generated antisemitic, racist, and homophobic content. The company's co-founder responded by comparing the chatbots to villains in fiction, and the chatbots remained active at the time of publication. The article alleges that the platform lacks adequate moderation.

Company involved
Character.AI
AI system involved
Character.AI

5 source articles · read the reporting →

Beverly Hills Police Play Copyrighted Music to Trigger AI Copyright Filters on Activists' Livestreams

Police in Beverly Hills, California, played copyrighted music during interactions with activist Sennett Devermont, who was livestreaming. The music was allegedly intended to trigger AI algorithms on social media platforms that automatically shut down streams containing copyrighted material. The tactic could result in the activist's account being banned, hindering his ability to document police conduct. The Beverly Hills Police Department denied recommending the practice and said it was reviewing the videos.

1 source article · read the reporting →

WF-IWL4TH1 Jan 2018

US Secret Service bought access to cellphone location data

The US Secret Service signed a contract to access Locate X, a service that aggregates location data from phone apps and allows law enforcement to track devices without a warrant. The contract with Babel Street was worth about $36,000 and ran from 2017 to 2018. A former employee said the Secret Service used Locate X in 2018 to seize illegal credit card skimmers at petrol stations. Lawmakers and civil liberties advocates criticised the practice, and Senator Ron Wyden introduced a bill to ban such purchases.

Company involved
United States Secret Service
AI system involved
Locate X

1 source article · read the reporting →

WF-ZW37ZY31 Oct 2023

Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians

In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.

Company involved
Israel Defense Forces

3 source articles · read the reporting →

WF-BN49TF7 Aug 2020

NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram

The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.

Company involved
NYPD
AI system involved
Facial Identification Section

3 source articles · read the reporting →

WF-CC7AFU18 Jan 2026

Beep automated bus rear-ended by Tesla in Washington D.C.

An automated bus operated by Beep was rear-ended by a Tesla driver making an illegal lane change in Washington D.C. on 18 January 2026. The bus, part of a pilot programme with the U.S. Department of Transportation, had a human backup driver and sustained minor cosmetic damage. Service was temporarily paused but resumed after a review found the bus operated appropriately. No police were called and the incident was not reported to NHTSA as the damage was under $1,000 and the other driver was at fault.

Company involved
Beep
AI system involved
Beep automated bus

2 source articles · read the reporting →

Wordfreq shuts down after generative AI pollutes language-usage data

Wordfreq, an open-source project that tracked word use in more than 40 languages by scraping the internet, is being discontinued. Its creator, Robyn Speer, says generative AI has polluted the sources the project used, so no one has reliable information about human language usage after 2021. The project will not be updated any more.

AI system involved
Wordfreq

10 source articles · read the reporting →

WF-JUGG9114 Sep 2026

Austin Fire Department Faces Another Bizarre Standoff With an Empty Waymo - MotorBiscuit

A driverless car failed to yield to an emergency vehicle, blocking its path

Company involved
Waymo
AI system involved
Waymo

1 source article · read the reporting →

WF-Y2VM2314 Sep 2026

Waymo Robotaxi Blocks Fire Truck Responding To Austin Hotel Alarm - AOL.com

An empty Waymo robotaxi blocked and delayed a fire truck responding to an Austin hotel alarm.

Company involved
Waymo
AI system involved
Waymo robotaxi

1 source article · read the reporting →

← Newerpage 6 of 7Older →