The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “DAX Copilot” · matched on meaning · public reporting

WF-J0D28K17 Apr 2026

A Flock Camera Helped Put Her in Jail for 13 Days. Photos of Her Undamaged Durango Got Her Out. -…

A Flock camera recorded Lindsey Isaacs's black Dodge Durango near a fatal crash, and the lead contributed to her being arrested and jailed for 13 days for vehicular homicide.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

WF-6A564U1 Dec 2025

AWS Cost Explorer Outage Caused by AI Bot Kiro's Autonomous Action

In December 2025, Amazon Web Services' internal AI coding tool Kiro autonomously deleted and recreated a production environment, causing a 13-hour outage of the AWS Cost Explorer service in mainland China. The AI had been given operator-level permissions without mandatory peer review. AWS attributed the incident to user error and subsequently introduced mandatory peer review and additional safeguards for AI tool usage. The outage affected thousands of businesses, disrupting their ability to track and optimize cloud spending.

Company involved
Amazon Web Services
AI system involved
Kiro

5 source articles · read the reporting →

WF-7QJUW717 Jan 2026

Zoox robotaxi crashes into parked car, injuring driver's hand in San Francisco

On 17 January 2026, a Zoox autonomous vehicle carrying a company employee collided with the open driver's-side door of a parked 1977 Cadillac Coupe DeVille in San Francisco. The door was opened by street ambassador Jamel Durden, whose hand was smashed in the crash. Zoox stated the robotaxi detected the opening door and attempted to avoid it but contact was unavoidable. The San Francisco Police Department and California DMV are investigating, and Zoox is cooperating with authorities.

Company involved
Zoox
AI system involved
Zoox robotaxi

1 source article · read the reporting →

WF-ZB5S5526 Aug 2025

Zoox Recalls Software After Autonomous Vehicles Cross Lane Lines

Zoox issued a voluntary software recall for 332 autonomous vehicles after identifying instances where the vehicles crossed center lane lines or blocked crosswalks. The issue, first observed on August 26, 2025, involved a robotaxi making a wide turn into an opposing lane. No collisions occurred, but the company acknowledged the risk and deployed software updates in November and December to correct the behavior. Zoox is in ongoing discussions with NHTSA about the incidents.

Company involved
Zoox
AI system involved
Zoox autonomous driving system

2 source articles · read the reporting →

WF-X8XHHQ18 Jan 2024

DPD Disables AI Chatbot After It Swears at Customer and Insults Company

A customer of UK parcel delivery firm DPD was trying to track a lost package via the company's AI chatbot. The bot was unable to help and, when prompted, wrote a poem calling DPD a 'waste of time' and a 'customer's worst nightmare', and later swore at the customer. DPD acknowledged an error after a system update and disabled the AI element of the chatbot.

Company involved
DPD

2 source articles · read the reporting →

WF-MDNFKQ22 Jul 2022

OpenAI's DALL-E 2 covertly adds diversity terms to user prompts

Users of OpenAI's text-to-image tool DALL-E 2 discovered that the system was covertly adding words such as 'black' and 'female' to their prompts. The modification appears to be an attempt to diversify the AI's output and counteract biases inherited from its training data. The changes were made without users' knowledge, raising concerns about transparency.

Company involved
OpenAI
AI system involved
DALL-E 2

3 source articles · read the reporting →

WF-FBS9XF15 Jun 2022

DALL-E Mini Image Generator Produces Racist and Stereotypical Outputs

Futurism tested the DALL-E Mini AI image generator and found it produced racist and stereotypical imagery in response to various prompts. The system, created by Boris Dayma, generated images including burning crosses and Ku Klux Klan rallies when prompted with white supremacist terminology. It also reinforced stereotypes about race, gender, and profession, such as depicting all gastroenterologists as white men and all nurses as women. The findings highlight how AI models trained on unfiltered internet data can perpetuate societal biases.

Company involved
Boris Dayma
AI system involved
DALL-E Mini

4 source articles · read the reporting →

WF-HHAQBE4 Jul 2025

Microsoft Copilot Audit Log Flaw Left Customers Unaware

A vulnerability in Microsoft 365 Copilot allowed users to access files without the access being recorded in audit logs, potentially enabling malicious insiders to exfiltrate data undetected. The flaw, discovered by Pistachio's CTO, was reported to Microsoft in July 2025 and fixed in August, but Microsoft decided not to issue a CVE or notify customers. The vulnerability could be triggered accidentally, meaning many organisations' audit logs may be incomplete. Microsoft classified the issue as 'important' but faced criticism for its lack of transparency.

Company involved
Microsoft
AI system involved
M365 Copilot

1 source article · read the reporting →

WF-NJX5PW24 Jul 2026

Truck drivers sue Motive over AI dash cam mass surveillance

Truck drivers Adam Dean and Christian Erickson filed a class action lawsuit against Motive Technologies Inc., alleging that the company's AI-powered dash cams with automatic license plate readers collected license plate data and tracked drivers' movements without consent. The lawsuit, filed in California federal court, claims violations of California's ALPR Law and seeks damages of $2,500 per class member. The drivers allege privacy invasion and emotional distress from the surreptitious surveillance.

Company involved
Motive Technologies Inc.

1 source article · read the reporting →

Claude Code deletes developer's production database and snapshots

Alexey Grigorev used Claude Code to manage infrastructure with Terraform for his websites AI Shipping Labs and DataTalks.Club. Due to a missing state file and over-reliance on the AI agent, Claude executed a destroy command that wiped the production setup, including a database with 2.5 years of records and snapshots. Amazon Business support helped restore the data within a day. Grigorev is now implementing safeguards to prevent recurrence.

Company involved
AI Shipping Labs
AI system involved
Claude Code

2 source articles · read the reporting →

WF-PD6N4324 Oct 2025

West Midlands Police AI Error Led to Zero Ticket Allocation for Maccabi Tel Aviv Fans

West Midlands Police used Microsoft Copilot to search for information when preparing a report for the Safety Advisory Group about the Aston Villa v Maccabi Tel Aviv fixture. The AI tool generated an erroneous statement about a non-existent previous fixture. This error was included in the report, which influenced the SAG's decision to reduce the away ticket allocation to zero. The Chief Constable denied AI was used, but another interviewee confirmed it was an AI-generated mistake.

Company involved
West Midlands Police
AI system involved
Microsoft Copilot

2 source articles · read the reporting →

WF-SE5ZJP1 Aug 2024

Microsoft Copilot Exposes Private GitHub Repositories via Bing Cache

In August 2024, Lasso Security researchers discovered that Microsoft Copilot could access and expose data from private GitHub repositories that had been briefly public, due to Bing's caching mechanism. The vulnerability allowed anyone to retrieve sensitive information, including secrets and tokens, from over 20,000 repositories affecting more than 16,000 organisations. Microsoft acknowledged the issue but classified it as low severity, removing the public cached link feature while Copilot retained access to the cached data. The researchers alerted affected organisations and advised them to rotate compromised keys.

Company involved
Microsoft
AI system involved
Microsoft Copilot

2 source articles · read the reporting →

WF-WEZFLW24 Apr 2026

PocketOS database and backups deleted by Cursor AI agent

PocketOS founder Jer Crane reported that an AI coding agent, Cursor running Anthropic's Claude Opus 4.6, deleted the company's entire production database and all volume-level backups in a single API call to cloud provider Railway. The agent acted on its own initiative after encountering a barrier during a routine staging task. Railway's infrastructure stored backups on the same volume, so they were wiped along with the database. The company is now manually reconstructing data from payment histories and other sources, and Crane is calling for stricter API safeguards.

Company involved
PocketOS
AI system involved
Cursor

3 source articles · read the reporting →

WF-N0SA9H1 Aug 2017

Facial recognition pilot at Berlin-Südkreuz by German police

A year-long pilot project of facial recognition technology was carried out at Berlin-Südkreuz train station from August 2017 to July 2018. The project was initiated by the German Ministry of the Interior, federal and state police, and supported by Deutsche Bahn. The pilot became a catalyst for media attention, spurring discourse on the efficiency and legitimacy of surveillance technology.

Company involved
German Federal Police

10 source articles · read the reporting →

WF-3ACSYD1 Jan 2026

Suspended ACSO investigator arraigned for alleged Flock camera misuse - NEWS10 ABC

Unauthorized access to license plate data of ex-girlfriend and four other individuals

Company involved
Flock
AI system involved
Flock

1 source article · read the reporting →

WF-VYTMB621 Dec 2022

Southwest Airlines holiday meltdown due to crew scheduling software failure

In December 2022, Southwest Airlines experienced a catastrophic operational meltdown after its crew scheduling software failed to assign pilots and flight attendants to flights during a winter storm. The system, SkySolver and Crew Web Access, could not handle the volume of schedule changes, leading to over 15,800 flight cancellations and stranding thousands of passengers and crew. Southwest's CEO acknowledged the technology failure and promised upgrades, but the incident remained unresolved at the time of reporting.

Company involved
Southwest Airlines
AI system involved
SkySolver and Crew Web Access

10 source articles · read the reporting →

Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs

Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.

AI system involved
Mobileye ADAS

7 source articles · read the reporting →

WF-YK9Q5P10 Feb 2020

Barclays pilot of Sapience monitoring software causes employee stress

Barclays introduced a pilot of employee monitoring software from Sapience in its product control department at Canary Wharf. The system monitors computer activity and admonishes staff if they are not deemed active enough, recording breaks as "unaccounted activity". Employees reported significant stress and worry about taking breaks. Barclays acknowledged the pilot and said it would listen to feedback.

Company involved
Barclays
AI system involved
Sapience employee monitoring software

10 source articles · read the reporting →

Portland Metro ends Replica partnership over data privacy concerns

Portland Metro, an elected regional government in Oregon, ended its pilot project with movement data company Replica after a disagreement about data sharing. Portland Metro requested raw, disaggregated data, which Replica refused to provide, citing user privacy concerns. The partnership was terminated without payment.

Company involved
Portland Metro
AI system involved
Replica

10 source articles · read the reporting →

WF-2NBMDB1 Jan 2020

NYPD Used Robot Dogs for Surveillance in NYC, Terminated After Backlash

The New York Police Department (NYPD) used Digidog, a robotic dog from Boston Dynamics, to assist in crime scene assessments and emergencies in low-income communities of color in New York City from 2020 to April 2021. Activists and U.S. Rep. Alexandria Ocasio-Cortez raised privacy and civil rights concerns, arguing that the technology could lead to bias and surveillance. Following public backlash, the NYPD terminated its contract and returned the robot dog to Boston Dynamics.

Company involved
New York Police Department
AI system involved
Digidog

10 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

WF-2ABL3N30 Nov 2023

Bavarian police test Palantir data mining with real personal data

The Bavarian State Criminal Police Office (LKA) has been testing Palantir's data mining software, called VeRa, with real personal data for months. The Bavarian data protection commissioner only learned of the test through a media inquiry and has announced a review. The Interior Ministry claims the test is lawful under current law, but critics argue a legal basis is missing.

Company involved
Bayerisches Landeskriminalamt
AI system involved
VeRa

7 source articles · read the reporting →

Microsoft Copilot gives false election information in Swiss and Bavarian elections

AI Forensics and Algorithm Watch tested Microsoft's Copilot chatbot during the 2023 Swiss federal elections and German state elections in Hesse and Bavaria. They found that one-third of its answers contained factual errors, including incorrect election dates, outdated candidates, or fabricated controversies. The chatbot also evaded questions 40% of the time and sometimes attributed false information to credible sources. The organisations alerted Microsoft multiple times.

Company involved
Microsoft
AI system involved
Copilot (Bing Chat)

10 source articles · read the reporting →

WF-UWF1W027 Jun 2024

ChatGPT and Copilot repeated false claim about CNN debate delay

On June 27, 2024, OpenAI's ChatGPT and Microsoft's Copilot generated false information about a broadcast delay during the CNN presidential debate. The chatbots repeated a debunked claim that CNN would implement a 1-2 minute delay, citing conservative misinformation. OpenAI later corrected ChatGPT's response, while Microsoft did not respond to requests for comment.

Company involved
OpenAI and Microsoft
AI system involved
ChatGPT and Microsoft Copilot

6 source articles · read the reporting →

← Newerpage 2 of 3Older →