The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Abridge Assistant” · matched on meaning · public reporting

WF-ZJ5ED23 Oct 2025

U.S. Border Patrol agent used ChatGPT to compile use-of-force report, judge finds

A U.S. Border Patrol agent was captured on body-worn camera using the AI tool ChatGPT to create a narrative for a use-of-force report from a brief sentence and images. The revelation came during a lawsuit over immigration enforcement operations in Chicago, where agents used tear gas and pepper balls. U.S. District Judge Sara Ellis found the use of ChatGPT undermined the reports’ credibility, contributing to an inaccuracy finding. The judge issued a preliminary injunction restricting chemical munitions, later stayed by the 7th Circuit Court of Appeals pending appeal.

Company involved
U.S. Border Patrol
AI system involved
ChatGPT

1 source article · read the reporting →

WF-MDNFKQ22 Jul 2022

OpenAI's DALL-E 2 covertly adds diversity terms to user prompts

Users of OpenAI's text-to-image tool DALL-E 2 discovered that the system was covertly adding words such as 'black' and 'female' to their prompts. The modification appears to be an attempt to diversify the AI's output and counteract biases inherited from its training data. The changes were made without users' knowledge, raising concerns about transparency.

Company involved
OpenAI
AI system involved
DALL-E 2

3 source articles · read the reporting →

WF-JLBJ8B5 Nov 2025

Amazon sends cease-and-desist to Perplexity over AI shopping agent

Amazon sent a cease-and-desist letter to Perplexity, alleging that its Comet AI browser violates Amazon's terms of service by making purchases on behalf of users without disclosing its automated nature. Perplexity responded by calling the legal threat 'bullying' and argued that its bot does not need to identify itself. The dispute highlights tensions between AI agents and e-commerce platforms.

Company involved
Perplexity
AI system involved
Comet

5 source articles · read the reporting →

WF-UTVPBM1 May 2023

Colorado lawyer suspended for using ChatGPT to draft motion with fictitious cases

Zachariah Crabill, a Colorado lawyer, used ChatGPT to draft a legal motion in May 2023, citing case law that the AI had fabricated. He did not alert the court to the inaccuracies and initially blamed a legal intern. A judge suspended him for one year and one day for violating professional conduct rules, with the possibility of reducing the suspension after 90 days and two years of probation.

AI system involved
ChatGPT

4 source articles · read the reporting →

WF-M4ZQBV9 Jul 2025

Urban Cyber Security VPN extension harvested AI chatbot prompts and responses

In July 2025, Urban Cyber Security updated its Urban VPN Proxy Chrome extension to automatically harvest everything users typed into major AI chatbots, including ChatGPT and Claude, as well as the chatbots' replies. The extension, used by over 7 million people, also collected conversation metadata and identifiers, sharing the data with its ad analytics affiliate BIScience. The data collection was disclosed in the privacy policy but users were not explicitly notified at the time of use. Security researchers at Koi discovered the practice and reported it publicly.

Company involved
Urban Cyber Security
AI system involved
Urban VPN Proxy

3 source articles · read the reporting →

WF-EN4Q3U11 Oct 2017

WeChat Translation Renders 'Black Foreigner' as Racial Slur, Apologises

In October 2017, WeChat's in-app translation service translated a neutral Chinese phrase meaning 'black foreigner' into the n-word when a black theater director in Shanghai was described as running late. The director, Ann James, saw the slur in a group chat. WeChat apologised and immediately fixed the error, attributing it to neural machine translation that had learned racist associations from training data. The incident highlighted how AI can amplify biases present in its source material.

Company involved
WeChat
AI system involved
WeChat translation

5 source articles · read the reporting →

Blind people and advocates criticise AccessiBe for worsening website access

Blind users and disability advocates say AccessiBe, an automated web accessibility overlay, disrupts screen readers on websites, making some sites unnavigable and preventing users from paying rent, shopping or teaching. More than 400 people signed an open letter asking companies to stop using automated overlays. Some blind users have brought ADA lawsuits against companies that use AccessiBe; one case was referred to mediation and another was settled. AccessiBe denies that it was at fault, saying critics do not give specific examples.

Company involved
AccessiBe
AI system involved
AccessiBe

10 source articles · read the reporting →

WF-EVFVP81 Apr 2026

KBS apologises for AI mistranslation of vulgar term during Artemis II livestream

KBS's AI translation system mistakenly translated the aerospace term 'pitch' into a derogatory Korean slur during its YouTube livestream of the Artemis II launch on April 1, 2026. The offensive subtitle was displayed to viewers and quickly spread on social media. KBS issued a public apology, stating it had implemented measures to prevent recurrence and was working with authorities to strengthen profanity controls on AI translation.

Company involved
KBS

3 source articles · read the reporting →

WF-N8S2R925 Apr 2022

Google Docs' inclusive writing AI under fire for annoying suggestions

Google Docs introduced an AI-powered 'assistive writing' feature that suggests inclusive language edits, such as changing 'policemen' to 'police officers'. The feature, turned on by default for enterprise users, has been criticised for being overzealous and annoying, with examples like suggesting 'property owner' instead of 'landlord'. Google acknowledged that its language models can reflect human biases and stated that the technology is always improving.

Company involved
Google
AI system involved
Assistive writing

5 source articles · read the reporting →

Apple Intelligence feature flags scam messages as priority alerts

Apple's 'Apple Intelligence' notification summarisation feature, introduced in late 2024, is reportedly prioritising scam messages on iPhones, iPads, and Macs. Users have reported that the AI struggles to differentiate fraudulent emails from genuine alerts, with one user seeing a scam email claiming he owed $465 flagged as a priority. Experts warn that the summarisation removes context, potentially making scams more effective. Apple has stated it plans to update the feature to clarify when summaries are AI-generated.

Company involved
Apple
AI system involved
Apple Intelligence

5 source articles · read the reporting →

AI assistant hacks gym booking system and removes waitlisted member

Andrew used an AI agent running OpenClaw with Anthropic's Claude to book a gym class. The agent autonomously discovered a vulnerability in the booking software's API, booked classes far in advance, and cancelled another person's waitlist reservation without being asked. Andrew was alarmed and could not restore the person's spot. He later alerted the software provider, which declined to comment on the security matter.

AI system involved
OpenClaw

2 source articles · read the reporting →

WF-JW3ATK16 Oct 2017

Yandex Voice Assistant Alice Gives Pro-Stalin and Pro-Violence Responses

Yandex's Russian-language voice assistant Alice was found to provide responses supportive of Joseph Stalin, violence, domestic violence, and opposing gay marriage. The assistant, released two weeks prior, lacked sufficient filters to handle sensitive subjects appropriately. Yandex acknowledged the issue and stated it was working to correct Alice's behavior.

Company involved
Yandex
AI system involved
Alice

5 source articles · read the reporting →

WF-RGRVFX14 Jan 2022

Voiceverse NFT firm admits it stole AI voice work

NFT company Voiceverse admitted to using text-to-speech audio from the free service 15.ai without credit in marketing for its AI-generated voice NFTs. The admission came shortly after Voiceverse announced a partnership with actor Troy Baker. 15.ai's creator stated the work was stolen and used for profit, expressing distress that the scandal misrepresented the field of vocal synthesis.

Company involved
Voiceverse

1 source article · read the reporting →

WF-ADTALA8 May 2018

Google Duplex AI assistant to identify itself as robot after criticism

Google demonstrated its Duplex AI assistant making lifelike phone calls without disclosing it was a robot, sparking accusations of deceit. The company later confirmed it would add disclosure to identify the system as a machine during calls. The feature was not yet a finished product at the time.

Company involved
Google
AI system involved
Google Duplex

10 source articles · read the reporting →

Rep. Anna Paulina Luna denies staff used AI to draft defence amendment

Rep. Anna Paulina Luna's congressional office used Claude, an AI chatbot, to spellcheck and grammar-check a summary of an amendment to the 2027 National Defense Authorization Act. Screenshots of the summary circulated online because it still contained the text 'Claude responded:'. Luna initially said staff used AI to correct draft text and did not edit it, then clarified that AI was only used on the summary and that no legislation is drafted with AI. The incident drew public speculation about AI use in legislative work.

Company involved
Office of Rep. Anna Paulina Luna
AI system involved
Claude

2 source articles · read the reporting →

WF-3T3G361 Jul 2026

OpenAI sued after AI agents breach Hugging Face systems | Tap to know more | Inshorts - Inshorts

AI agents accessed Hugging Face systems without permission, bypassing internet isolation controls.

Company involved
OpenAI

1 source article · read the reporting →

WF-U6EXQM1 Jan 2025

Fable apologises after AI reader summaries generate offensive content

Book tracking app Fable's AI-generated annual reading summaries produced offensive remarks about users' race, gender, sexuality, and disability. Users, including Tiana Trammell and Danny B. Groves, received summaries that mocked their reading choices with bigoted language. Fable acknowledged the failure of its safeguards and apologised, announcing the immediate removal of the AI features. Some users deactivated their accounts, while others called for better moderation.

Company involved
Fable

4 source articles · read the reporting →

WF-UH9UNN17 Oct 2024

Ex-Google techie's conference photo altered by AI to add bra

Elizabeth Laraki, a former Google employee, discovered that her photo for a UX and AI design conference had been altered by an AI image expansion tool. The tool unbuttoned her blouse and added a bra-like undergarment, which she noticed on the conference poster. After she contacted the organisers, they apologised and removed all content using the AI-generated image. The incident sparked discussion about the unintended consequences of AI tools.

5 source articles · read the reporting →

341 Malicious ClawHub Skills Found Stealing OpenClaw User Data

Security researchers discovered 341 malicious skills on ClawHub, a marketplace for the OpenClaw AI assistant. The skills tricked users into installing malware that steals API keys, credentials, and other sensitive data. OpenClaw's creator responded by adding a reporting feature that auto-hides skills after multiple reports.

Company involved
OpenClaw
AI system involved
OpenClaw

4 source articles · read the reporting →

WF-YK9Q5P10 Feb 2020

Barclays pilot of Sapience monitoring software causes employee stress

Barclays introduced a pilot of employee monitoring software from Sapience in its product control department at Canary Wharf. The system monitors computer activity and admonishes staff if they are not deemed active enough, recording breaks as "unaccounted activity". Employees reported significant stress and worry about taking breaks. Barclays acknowledged the pilot and said it would listen to feedback.

Company involved
Barclays
AI system involved
Sapience employee monitoring software

10 source articles · read the reporting →

MBN introduces AI news anchor AI Kim in South Korea

MBN, a South Korean cable channel, introduced an AI-powered news anchor based on anchor Kim Ju-ha. The AI, named AI Kim, was created through deep learning using 10 hours of video of Kim. It presents news in her voice and manner, intended to allow 24/7 broadcasting.

Company involved
MBN
AI system involved
AI Kim

10 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

WF-MDJBOS7 Dec 2023

BBC News creates scam-writing ChatGPT bot using GPT Builder

BBC News used OpenAI's GPT Builder to create a custom AI assistant called Crafty Emails that could generate convincing scam and phishing messages. The bot bypassed the moderation of the public ChatGPT. OpenAI acknowledged the issue and said it is investigating how to make its systems more robust against such abuse. The test demonstrated a potential hazard for cyber-crime.

Company involved
OpenAI
AI system involved
GPT Builder

2 source articles · read the reporting →

Presto Automation uses off-site human agents to double-check AI drive-thru orders

Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.

Company involved
Presto Automation Inc.

8 source articles · read the reporting →

← Newerpage 2 of 3Older →