The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

100 incidents closest to “Pega Customer Decision Hub” · matched on meaning · public reporting

WF-IJU2642 Mar 2026

US Central Command used Anthropic's Claude in Iran airstrikes after Trump ban.

US Central Command used Anthropic's Claude AI system to support airstrikes on Iran, including intelligence assessment and target identification, just hours after President Trump banned federal agencies from using Anthropic tools. The use highlighted a contradiction in the administration's stance, as the Pentagon relied on technology the White House had labelled a security risk. Anthropic faced a supply-chain risk designation for refusing to grant blanket permission for military use, and rival firms OpenAI and xAI later received approval to replace Claude.

Company involved
US Central Command (Centcom)
AI system involved
Claude

4 source articles · read the reporting →

SoftBank's Pepper robot fails at multiple customer service jobs

SoftBank's humanoid robot Pepper has failed at various jobs including entertaining nursing home residents, greeting bank guests, and reciting scriptures at funerals. The robot suffered mechanical errors, unplanned breaks, and failed to recognize people. Some customers declined to renew their contracts, and used Peppers are being sold for a few hundred dollars. Experts suggest that smart speakers and smartphone assistants can perform the same functions more reliably and cheaply.

AI system involved
Pepper

3 source articles · read the reporting →

WF-2ZQ1HW24 Jul 2020

PredictiveHire builds AI to predict job hopping from interviews

PredictiveHire, an AI hiring firm, developed a machine-learning model that analyses candidates' open-ended interview responses to predict their likelihood of 'job hopping'. The company used data from 45,899 applicants to build the 'flight risk' assessment, which it advertises as coming soon. Scholars warn that such tools can suppress wages by screening out workers who might seek better pay or conditions, continuing a historical trend of using personality tests to identify potential labour organisers.

Company involved
PredictiveHire
AI system involved
Phai

1 source article · read the reporting →

WF-2S4JVP10 Sep 2020

Ola drivers file GDPR lawsuit over algorithmic management and data access

Two ride-hailing drivers are taking Ola to court in Amsterdam, alleging the company violated GDPR data access rights by not providing full personal data, including GPS and ratings information. They argue this hinders their ability to challenge algorithmic decisions, such as a driver who had pay docked after Ola's system incorrectly flagged trips as invalid. The case, supported by the App Drivers & Couriers Union, seeks to compel Ola to comply with data protection law and faces fines for non-compliance. Ola says it has not received notification and complies with all applicable laws.

Company involved
Ola
AI system involved
Guardian

1 source article · read the reporting →

WF-SU17EB1 Mar 2026

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved
Pankaj
AI system involved
AI roommate

5 source articles · read the reporting →

WF-8XLWG27 Jun 2024

Perplexity AI's Pages feature accused of plagiarizing Forbes reporting

Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.

Company involved
Perplexity AI
AI system involved
Perplexity Pages

10 source articles · read the reporting →

Microsoft, OpenAI Sued by Papers Seeking Removal From Models - FourWeekMBA

Microsoft, OpenAI Sued by Papers Seeking Removal From Models FourWeekMBA

Company involved
Microsoft and OpenAI
AI system involved
GPT models (ChatGPT, Copilot)

1 source article · read the reporting →

WF-IGDMEM1 Jun 2024

What the McDonald’s AI failure reveals about AI agent mistakes - cio.com

The system took and processed customer food orders at the drive-thru, resulting in incorrect orders for some customers.

Company involved
McDonald’s

1 source article · read the reporting →

DFFH breaches privacy by using ChatGPT in child protection report

A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.

Company involved
Department of Families, Fairness and Housing
AI system involved
ChatGPT

9 source articles · read the reporting →

Target's pregnancy prediction algorithm reveals teen's pregnancy to father

Target used a data mining algorithm to predict when customers were pregnant based on their purchases. The algorithm sent baby product coupons to a high school student, leading her father to complain to the store. The father later learned his daughter was indeed pregnant. Target subsequently altered the coupons to disguise the data mining.

Company involved
Target
AI system involved
Target pregnancy prediction algorithm

9 source articles · read the reporting →

WF-XPFO9119 Aug 2019

Engineer.ai accused of exaggerating AI capabilities and using human engineers

Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.

Company involved
Engineer.ai

6 source articles · read the reporting →

WF-3WZ49Y1 Jul 2025

Commonwealth Bank worker made redundant after unknowingly training AI chatbot to replace her

Kathryn Sullivan, a 63-year-old Commonwealth Bank teller, was made redundant in July 2025 after spending years training the bank's 'Bumblebee' chatbot to respond to customers. She was unaware that she was helping the AI replace her own role. Sullivan confronted CEO Matt Comyn at the bank's AGM in Brisbane, where chairman Paul O'Malley acknowledged the bank had made a mistake. The Finance Sector Union had brought a case before the Fair Work Commission, resulting in some jobs being offered back, but not all.

Company involved
Commonwealth Bank
AI system involved
Bumblebee

4 source articles · read the reporting →

WF-UDDP7B6 Dec 2017

Illinois DCFS ends unreliable predictive analytics program for child abuse risk

The Illinois Department of Children and Family Services ended its Rapid Safety Feedback program, which used data mining to predict child abuse risk, after the agency's director called the technology unreliable. The system, developed by Eckerd Connects and Mindshare Technology, assigned risk scores to children but failed to flag several high-profile child deaths. The program was also criticised for overwhelming caseworkers with alerts and for potential bias against poor children of colour. DCFS decided not to renew the contract.

Company involved
Illinois Department of Children and Family Services
AI system involved
Rapid Safety Feedback

10 source articles · read the reporting →

WF-WS57YP1 May 2026

Dealership revoked offer to buy back customer's BMW, blaming wayward AI chatbot - cbc.ca

The AI chatbot offered a buy-back price of $27,162.79 to customer Zack Giacomelli for his BMW.

Company involved
BMW Toronto
AI system involved
Quinn

1 source article · read the reporting →

U.S. Federal Court Allows CIPA Class Action Against AI Customer Service Provider to Proceed - Wilson Sonsini

The AI system intercepted and recorded a customer's phone call and collected her personal and financial information without consent.

Company involved
ConverseNow Technologies, Inc.

1 source article · read the reporting →

Lenovo chatbot breach highlights AI security blind spots in customer-facing systems - csoonline.com

Lenovo chatbot breach highlights AI security blind spots in customer-facing systems csoonline.com

Company involved
Lenovo
AI system involved
Lena

1 source article · read the reporting →

Patagonia Targeted by Privacy Class Action for Use of Customer Service AI Software - Law.com

The system intercepted, recorded, and mined data from customer service calls, affecting customers' privacy.

Company involved
Patagonia
AI system involved
Talkdesk

1 source article · read the reporting →

MAJOR LAWSUIT ALERT!: Home Depot And Google Facing CIPA Lawsuit For Use Of Google’s Cloud Contact Center AI - natlawreview.com

The system recorded and transcribed customer service calls without consent, affecting the privacy of callers.

Company involved
Home Depot
AI system involved
Google Cloud Contact Center AI

1 source article · read the reporting →

Call Vendors Skirt Wiretap Suit Over AI Transcription Tool - Law360

The system recorded and analyzed patient phone calls without their consent.

Company involved
Heartland Dental LLC

1 source article · read the reporting →

WF-OSKUN01 Jan 2021

Lawsuit alleges Google violated California privacy laws recording Home Depot customer service calls - CX Dive

The system recorded and analyzed customer service calls and suggested agent replies without callers' consent.

Company involved
Home Depot
AI system involved
Cloud Contact Center AI

1 source article · read the reporting →

Dialpad class action claims AI tech company illegally ‘taps’ T-Mobile customer service calls - Top Class Actions

The system intercepted and recorded telephone conversations of T-Mobile customers calling customer service without their consent.

Company involved
Dialpad Inc.
AI system involved
Dialpad conversation intelligence platform, DialpadGPT

1 source article · read the reporting →

Not Again! A Second Talkdesk Customer Is Sued for Its Use of Contact Center AI - cxtoday.com

The system intercepted, recorded, and analyzed the communications of LegalShield customers without their consent.

Company involved
LegalShield
AI system involved
Talkdesk CCaaS

1 source article · read the reporting →

WF-QK5KCO3 Aug 2026

Delta’s AI Told A Passenger Her Flight Home Was Safe, Then Canceled It And Demanded Double To Rebook - View…

The AI canceled the passenger's entire roundtrip award ticket, including the return flight, after the passenger requested only the outbound be canceled.

Company involved
Delta Air Lines
AI system involved
Delta Concierge

1 source article · read the reporting →

Talkdesk Hit With Class Suit Over Customer Service Software - news.bloomberglaw.com

The system secretly recorded and analyzed customer service conversations of callers to Patagonia and Zumiez without consent.

Company involved
Talkdesk Inc.
AI system involved
CX Cloud

1 source article · read the reporting →

← Newerpage 4 of 5Older →