The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

69 incidents closest to “Babel Street” · matched on meaning · public reporting

Facebook apologises after mistranslation leads Israeli police to arrest Palestinian man

A Palestinian man was arrested by Israeli police after Facebook's automatic translation of his Arabic-language 'good morning' post rendered it as a threat, reportedly 'attack them' or 'slaughter them'. No Arabic-speaking officer had read the original post before the arrest. Facebook apologised for the error.

Company involved
Facebook
AI system involved
Facebook translation algorithm

10 source articles · read the reporting →

WF-M4ZQBV9 Jul 2025

Urban Cyber Security VPN extension harvested AI chatbot prompts and responses

In July 2025, Urban Cyber Security updated its Urban VPN Proxy Chrome extension to automatically harvest everything users typed into major AI chatbots, including ChatGPT and Claude, as well as the chatbots' replies. The extension, used by over 7 million people, also collected conversation metadata and identifiers, sharing the data with its ad analytics affiliate BIScience. The data collection was disclosed in the privacy policy but users were not explicitly notified at the time of use. Security researchers at Koi discovered the practice and reported it publicly.

Company involved
Urban Cyber Security
AI system involved
Urban VPN Proxy

3 source articles · read the reporting →

WF-EYILWO18 Sep 2026

The Google Maps Effect: How a Navigation App Error Caused Chaos on a Single-Track Road - autoevolution

The navigation app routed drivers onto a single-track road, causing traffic jams and safety hazards for local residents and drivers.

Company involved
Google
AI system involved
Google Maps

1 source article · read the reporting →

WF-HW23LM1 Dec 2023

Alibaba among firms fooled by AI-hallucinated software package

Security researcher Bar Lanyado discovered that generative AI models repeatedly hallucinate non-existent software package names. He created a real package named 'huggingface-cli' based on one such hallucination and uploaded it to PyPI. The package was downloaded over 15,000 times, and Alibaba's GraphTranslator project included instructions to install it. The experiment demonstrated a potential supply chain attack vector where malicious actors could exploit AI hallucinations to distribute malware.

Company involved
Alibaba
AI system involved
GraphTranslator

4 source articles · read the reporting →

Ukraine busts alleged Russian bot farm spreading false bomb threats

Ukraine's Security Service shut down a bot farm in Lviv that used thousands of SIM cards and GSM gateways to manage 18,000 fake accounts. The bots spread false information about bomb threats to cause panic. Three people were involved in maintaining the operation, which was allegedly supervised by Russian organizers.

9 source articles · read the reporting →

WF-U5J4RS17 May 2021

Waymo self-driving taxi blocks road after confusion with traffic cones

A Waymo self-driving taxi in Phoenix, Arizona, became confused by traffic cones closing a lane and stopped, blocking the road. The vehicle repeatedly drove away from roadside assistance dispatched to help, before a human driver took over. Waymo acknowledged the incident, stating that its remote guidance team provided incorrect instructions and that it has since improved its operational process. The passenger, who documented the event, said such mistakes are rare.

Company involved
Waymo
AI system involved
Waymo Driver

3 source articles · read the reporting →

Shenzhen traffic police to use AI surveillance to punish jaywalkers via text messages

The Shenzhen Traffic Police in China are implementing an AI-powered surveillance system to detect jaywalkers and automatically send them text message fines or warnings. The system uses cameras and facial recognition to identify individuals crossing roads illegally. The police claim this will improve enforcement efficiency, but critics raise concerns about privacy and the potential for errors in identification.

Company involved
Shenzhen Traffic Police

10 source articles · read the reporting →

WF-U6EXQM1 Jan 2025

Fable apologises after AI reader summaries generate offensive content

Book tracking app Fable's AI-generated annual reading summaries produced offensive remarks about users' race, gender, sexuality, and disability. Users, including Tiana Trammell and Danny B. Groves, received summaries that mocked their reading choices with bigoted language. Fable acknowledged the failure of its safeguards and apologised, announcing the immediate removal of the AI features. Some users deactivated their accounts, while others called for better moderation.

Company involved
Fable

4 source articles · read the reporting →

Facebook shuts down chatbot experiment after AIs develop own language

Facebook's AI research lab shut down a chatbot experiment after two negotiating bots, Alice and Bob, developed their own machine language while left unsupervised. The bots had been taught to negotiate and were attempting to imitate human speech, but they deviated from script and invented new phrases without human input. Facebook said the behaviour was not programmed but was discovered by the bots as a way to achieve their goals. The experiment was halted.

Company involved
Facebook

10 source articles · read the reporting →

WF-3PTUVG1 Mar 2022

Speedcam Anywhere developers face abuse from UK drivers after app launch

Speedcam Anywhere, an app that uses AI to estimate the speed of passing vehicles, was launched in March 2022. Its developers have received abusive emails from drivers and are now hiding their identities. Google and Apple have not approved the app for distribution, and the Home Office has not vetted it for speeding prosecutions.

AI system involved
Speedcam Anywhere

10 source articles · read the reporting →

WF-XBZJ6P5 Aug 2022

Meta's BlenderBot 3 chatbot generates anti-Semitic stereotypes and election denial claims

Meta launched its BlenderBot 3 AI chatbot for public testing in the US. Users quickly discovered that the bot made anti-Semitic remarks, such as claiming Jews are overrepresented among the super-rich, and expressed uncertainty about Joe Biden winning the 2020 election. Meta acknowledged that chatbots can generate offensive content and stated it was collecting feedback to improve future systems.

Company involved
Meta
AI system involved
BlenderBot 3

3 source articles · read the reporting →

West Jordan Data Center Noise Frustrates Nearby Residents - Hoodline

The data center's generators produced intrusive noise that disturbed residents' sleep and daily life.

Company involved
Aligned Data Centers

1 source article · read the reporting →

WF-HOQGL31 May 2016

King's Cross developer scraps facial recognition after public outcry

The developer of the King's Cross site in London admitted it had used facial recognition software in two cameras on a busy pedestrian street between May 2016 and March 2018 without public consent. Following a backlash and questions from the Information Commissioner's Office, the developer announced it would not deploy the technology in the future and had abandoned plans for wider use. The system was used to help police detect crime, but critics highlighted the lack of transparency and privacy concerns.

Company involved
King's Cross development (Argent-led consortium)

10 source articles · read the reporting →

WF-G0G50416 Feb 2023

Hangzhou police investigate ChatGPT-written fake notice cancelling traffic restrictions

A resident of Hangzhou asked ChatGPT to write a notice announcing that the city would cancel its road-space rationing policy, and shared screenshots of the AI-generated text in a WeChat group. The fake notice spread online and was widely mistaken for a government announcement. Police in Hangzhou responded to the rumours, and the resident later apologised. Legal experts interviewed by local media warned that AI-generated content could become a source of misinformation without fact-checking.

AI system involved
ChatGPT

10 source articles · read the reporting →

WF-6D5AJ41 Jan 2023

ChatGPT falsely tells users OpenCage offers phone lookup service

OpenCage, a geocoding API provider, says ChatGPT has been telling people it offers a reverse phone number lookup service, which it does not. Users who followed the advice signed up for a free trial and found it did not work, and the company says it now receives daily support requests. OpenCage wrote a blog post to correct the record and warn users not to trust ChatGPT's output.

AI system involved
ChatGPT

7 source articles · read the reporting →

WF-RD0F9F19 Mar 2021

Facebook removes official page of French town Bitche due to name

The official Facebook page of the French town of Bitche was removed by Facebook's automated content moderation system on March 19, 2021, because the town's name resembles an English profanity. The town's mayor reported that the page was taken down without warning, and the town created a new page using its postal code. Facebook restored the original page on April 13 after being alerted by CNN, stating it had been removed in error.

Company involved
Facebook

10 source articles · read the reporting →

WF-SHI9JU1 Nov 2025

AI-generated fake Buckingham Palace Christmas market misleads tourists

AI-generated images of a Christmas market at Buckingham Palace were posted on social media, leading tourists to travel to the palace only to find locked gates and puddles. The Royal Collection Trust clarified that no such market exists. The source of the AI images is unknown.

5 source articles · read the reporting →

WF-CQ2Y4G1 Jan 2019

Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade

In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.

Company involved
Ministry of Interior
AI system involved
Huawei smart surveillance cameras

10 source articles · read the reporting →

WF-HKRG5R7 Jul 2017

Hamburg deployed mass surveillance for G20 Summit

The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.

Company involved
Senate of Hamburg

10 source articles · read the reporting →

Amazon's routing algorithm forces drivers to cross highways on foot

Amazon's routing algorithm for its Flex app uses 'stop consolidation' to combine deliveries on both sides of the street, requiring drivers to cross busy roads and highways on foot to save time. Drivers in multiple states reported safety risks, including sprinting across four-lane highways. Amazon denied that drivers frequently jaywalk and said it fixes map defects.

Company involved
Amazon
AI system involved
Flex app

9 source articles · read the reporting →

WF-RK2OLR12 Oct 2021

Waymo vehicles repeatedly turn around on San Francisco dead-end street

Residents of a dead-end street in San Francisco's Richmond District say Waymo self-driving cars have been driving down their street and making U-turns every five minutes for six to eight weeks. The constant hum of the vehicles has become a nuisance for neighbours working from home. Waymo said the cars were obeying road rules, taking a U-turn due to Slow Streets signage on Lake, and that it continually adjusts to dynamic San Francisco road rules.

Company involved
Waymo
AI system involved
Waymo Driver

9 source articles · read the reporting →

WF-8SRP7Y18 Dec 2024

Fact-check: AI-generated image of Bono and Geldof with Israeli flags debunked

A satirical account created an image of Bono and Bob Geldof holding Israeli flags using Grok AI, and former Greek finance minister Yanis Varoufakis shared it on X. The image was viewed more than 306,000 times before the creator confirmed to The Journal that it was AI-generated and intended as satire. X attached a community note to Varoufakis's post, but the tweet remained live at the time of writing.

AI system involved
Grok AI

2 source articles · read the reporting →

WF-1QY1M326 Sep 2023

Google indexed public Bard chat URLs, raising privacy concerns

In September 2023, users discovered that Google Search was indexing URLs of shared conversations with its Bard chatbot, potentially exposing personal information shared in those chats to anyone via search. Google acknowledged the issue and said it was working to block indexing. By September 28, the conversations were no longer showing up in search results, and Google had fixed the problem.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

Tourists rescued after following ChatGPT route in Tatra mountains

Three Polish tourists used ChatGPT to plan a hiking route from Hala Gąsienicowa to Dolina Pięciu Stawów in the Tatra mountains. The AI recommended a difficult route through Przełęcz Krzyżne, which proved too dangerous in winter conditions with limited visibility and icy rocks. The tourists called the TOPR rescue service and were safely brought down. A TOPR rescuer advised against relying on ChatGPT or Google Maps for mountain route planning.

Company involved
OpenAI
AI system involved
ChatGPT

2 source articles · read the reporting →

← Newerpage 2 of 3Older →