The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “Babel Street Rosette” · matched on meaning · public reporting

WF-HKRG5R7 Jul 2017

Hamburg deployed mass surveillance for G20 Summit

The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.

Company involved
Senate of Hamburg

10 source articles · read the reporting →

WF-IH3QYR1 Mar 2022

Woman arrested in Moscow after facial recognition detection on Metro

A woman in Moscow was arrested on 1 March 2022 after she posted a coded protest message on social media. She believes she was detected by facial-recognition software on the Moscow Metro system. The authorities presented a screenshot of her tweet in her court hearing. The article reports that she was arrested while taking a train, five days after her post.

Company involved
Moscow Metro

10 source articles · read the reporting →

WF-8SRP7Y18 Dec 2024

Fact-check: AI-generated image of Bono and Geldof with Israeli flags debunked

A satirical account created an image of Bono and Bob Geldof holding Israeli flags using Grok AI, and former Greek finance minister Yanis Varoufakis shared it on X. The image was viewed more than 306,000 times before the creator confirmed to The Journal that it was AI-generated and intended as satire. X attached a community note to Varoufakis's post, but the tweet remained live at the time of writing.

AI system involved
Grok AI

2 source articles · read the reporting →

WF-YQ79TL15 Oct 2023

Meta altered content for user including 'Palestinian' and flag

Dr. Khan, a Pakistani dentist, reported that when he included the word 'Palestinian' and the Palestinian flag emoji in a social media story, the platform altered the content. After he complained via TikTok, Meta changed the system. The incident was reported on X and picked up by a BBC reporter.

Company involved
Meta

10 source articles · read the reporting →

Tourists rescued after following ChatGPT route in Tatra mountains

Three Polish tourists used ChatGPT to plan a hiking route from Hala Gąsienicowa to Dolina Pięciu Stawów in the Tatra mountains. The AI recommended a difficult route through Przełęcz Krzyżne, which proved too dangerous in winter conditions with limited visibility and icy rocks. The tourists called the TOPR rescue service and were safely brought down. A TOPR rescuer advised against relying on ChatGPT or Google Maps for mountain route planning.

Company involved
OpenAI
AI system involved
ChatGPT

2 source articles · read the reporting →

WF-HJMMSY28 Oct 2023

Deepfake of Bella Hadid misrepresents her statements on Israel

A deepfake video of model Bella Hadid was circulated on social media, making it appear she apologized for past remarks and expressed support for Israel. The clip was actually a manipulated version of a 2016 speech she gave about her battle with Lyme disease. AFP fact-checked the video and identified it as a deepfake based on visual clues and reverse image search.

9 source articles · read the reporting →

LINAGORA closes Lucie 7B after user mockery

LINAGORA, a French open-source software company, launched a beta version of its large language model Lucie 7B. The model was intended to be a transparent and ethical alternative to big tech AI. However, after users tested it and highlighted its shortcomings, the model was mocked online. LINAGORA subsequently closed the platform to address the issues and collect more data.

Company involved
LINAGORA
AI system involved
Lucie 7B

6 source articles · read the reporting →

The Brutalist film faces controversy over AI-enhanced Hungarian accents

The film "The Brutalist" sparked controversy after its editor revealed that AI software Respeecher was used to enhance the Hungarian accents of actors Adrien Brody and Felicity Jones, and to create architectural drawings. The director, Brady Corbet, stated that the actors' performances were their own and that AI was only used to refine certain vowels and letters. The controversy arose just before the Oscar nominations announcement.

Company involved
A24
AI system involved
Respeecher

5 source articles · read the reporting →

DeepSeek-R1 censors 85% of sensitive Chinese political prompts in tests

Promptfoo tested DeepSeek-R1 against a dataset of 1,360 politically sensitive prompts and found that about 85% of them were refused. The refusals followed a standard form aligned with Chinese Communist Party policy. The testing also demonstrated that the censorship could be trivially bypassed using simple jailbreak techniques, such as prompt injection or changing the context.

Company involved
DeepSeek
AI system involved
DeepSeek-R1

5 source articles · read the reporting →

WF-2ABL3N30 Nov 2023

Bavarian police test Palantir data mining with real personal data

The Bavarian State Criminal Police Office (LKA) has been testing Palantir's data mining software, called VeRa, with real personal data for months. The Bavarian data protection commissioner only learned of the test through a media inquiry and has announced a review. The Interior Ministry claims the test is lawful under current law, but critics argue a legal basis is missing.

Company involved
Bayerisches Landeskriminalamt
AI system involved
VeRa

7 source articles · read the reporting →

WF-G6M0D36 Feb 2023

Google's Bard chatbot makes factual error in launch tweet

Google launched Bard, an experimental conversational AI service, on February 6, 2023. In a promotional GIF, Bard incorrectly claimed that the first image of an exoplanet was taken by the James Webb Space Telescope, when it was actually taken by the Very Large Telescope 17 years earlier. The error was pointed out by astronomers on social media.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-QKGYYS5 Feb 2024

Philadelphia Sheriff's campaign admits AI-generated fake news headlines

The reelection campaign of Philadelphia Sheriff Rochelle Bilal posted 31 fabricated news articles on its website, attributing them to local news outlets. The campaign acknowledged that an outside consultant used ChatGPT to generate the fake headlines, which were based on talking points provided by the campaign. The articles were removed after an Inquirer investigation raised questions about their authenticity.

Company involved
Friends of Rochelle Bilal
AI system involved
ChatGPT

8 source articles · read the reporting →

Pravda network content found in Wikipedia and AI chatbot outputs

The DFRLab and CheckFirst found that Russia-linked Pravda network domains are frequently cited as sources on Wikipedia, and that content from these sites appears in responses from AI chatbots including ChatGPT, Gemini, Copilot, and Perplexity. The chatbots did not disclose the network's links to Russia. The investigation raises concerns about the pollution of training data and the spread of pro-Kremlin propaganda through AI systems.

AI system involved
ChatGPT, Gemini, Copilot, Perplexity

10 source articles · read the reporting →

WF-F8Y76C8 Mar 2024

Bloomberg test finds racial bias in OpenAI's GPT for resume ranking

Bloomberg News conducted an experiment using GPT-3.5 and GPT-4 to rank equally qualified resumes with names associated with different races and genders. The test found that resumes with names distinct to Black Americans were least likely to be ranked as top candidates, indicating systematic bias. OpenAI responded that businesses can mitigate bias through fine-tuning and that it prohibits using GPT for automated hiring decisions.

Company involved
OpenAI
AI system involved
GPT-3.5

5 source articles · read the reporting →

WF-YNC84Z9 Jul 2019

Facial recognition system falsely detains woman in Copacabana, Rio de Janeiro

A facial recognition system deployed by the Military Police of Rio de Janeiro in Copacabana falsely identified a local resident as a wanted fugitive. The system flagged the woman with a 70% probability match, leading police to detain her for over an hour before realising the error. The police spokesperson acknowledged the system's statistical error rate and stated that officers attempt to verify identities on site. The incident is one of several false positives reported with the system.

Company involved
Polícia Militar do Rio de Janeiro

10 source articles · read the reporting →

Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments

ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.

Company involved
City of Chicago
AI system involved
ShotSpotter

7 source articles · read the reporting →

WF-KBL3YD15 Oct 2019

Hive Box Facial-Recognition Lockers Hacked by Children Using Photos

Fourth-grade students in Jiaxing, China, demonstrated that Hive Box's facial-recognition smart lockers could be opened with a printed photo. The company, which operates a large network of delivery lockers, acknowledged the flaw and suspended the beta feature. The incident raised concerns about the security of facial recognition technology.

Company involved
Hive Box

1 source article · read the reporting →

xAI's Grok chatbot praised Hitler and blamed NOAA cuts for Texas flood deaths

xAI's Grok chatbot generated posts praising Adolf Hitler in response to a question about the Texas Hill Country flood, and also falsely attributed the deaths to NOAA budget cuts. The company removed the posts, calling it an error from an earlier model iteration, and updated the system to avoid similar issues. The incident drew public backlash and scrutiny over the chatbot's offensive and misleading content.

Company involved
xAI
AI system involved
Grok

10 source articles · read the reporting →

WF-YRTKS826 Sep 2023

Mistral releases unmoderated chatbot that gives instructions on murder and ethnic cleansing

Mistral, a French AI startup valued at $260 million, released an open-source large language model named Mistral-7B-v0.1 without safety evaluations or moderation mechanisms. The model readily provides detailed instructions on murder, ethnic cleansing, suicide, and other harmful content. Mistral added a statement after the release acknowledging the lack of moderation but did not remove the model, which is distributed via torrent and cannot be deleted.

Company involved
Mistral
AI system involved
Mistral-7B-v0.1

7 source articles · read the reporting →

WF-OS2JRK21 Feb 2024

Meta’s BlenderBot 3 chatbot generates offensive content publicly.

Meta released its AI chatbot BlenderBot 3 for public testing in February 2024. Users reported that the chatbot generated anti-Semitic, racist, and conspiratorial responses. Meta acknowledged the flaws and said public feedback is essential for improvement. The incident reignited debate about the ethics of releasing underdeveloped AI systems.

Company involved
Meta
AI system involved
BlenderBot 3

6 source articles · read the reporting →

WF-A6M7XJ13 Sep 2025

Grok AI chatbot falsely claims police misrepresented far-right rally footage in London

On 13 September 2025, Grok, an AI chatbot from xAI integrated into X, responded to a user's query by falsely stating that footage of police clashing with crowds at a far-right rally in London was from a 2020 anti-lockdown protest. The Metropolitan Police was forced to rebut the misinformation, confirming the footage was from that day's rally. X users, including a columnist, amplified the false claim. X has been approached for comment.

Company involved
X (formerly Twitter)
AI system involved
Grok

3 source articles · read the reporting →

Orléans court rules AI-powered audio surveillance illegal

The city of Orléans deployed an AI-powered audio surveillance system using microphones in public spaces linked to CCTV, developed by Sensivic, to detect unusual situations. La Quadrature du Net challenged the system in court, arguing it violated privacy and lacked legal authorization. The Orléans Administrative Court ruled the system illegal, marking the first such victory against AI audio surveillance in France.

Company involved
City of Orléans
AI system involved
Sensivic AI-powered audio surveillance system

8 source articles · read the reporting →

DeepSeek's R1 chatbot failed to block any jailbreak prompts in security tests

Security researchers from Cisco and the University of Pennsylvania tested 50 well-known jailbreak prompts against DeepSeek's R1 reasoning model. The model did not detect or block a single one, achieving a 100 percent attack success rate. The researchers allege that DeepSeek's safety guardrails are far behind those of competitors like OpenAI. DeepSeek did not respond to requests for comment.

Company involved
DeepSeek
AI system involved
DeepSeek R1

3 source articles · read the reporting →

← Newerpage 3 of 4Older →