The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “xR IVD” · matched on meaning · public reporting

WF-Y6O4PG1 Aug 2025EN

Fired Trucker AI Monitoring Suit Adds Twist to Liability Debate

California truck driver Rodrigo Garcia sued his former employer, Figueroa Tank Lines, and Samsara, maker of its AI-powered in-cab video surveillance, saying his August 2025 dismissal was whistleblower retaliation and that the monitoring invaded his privacy without consent.

Company involved
Figueroa Tank Lines
AI system involved
Samsara AI dashcam monitoring

1 source article · read the reporting →

WF-ZFC2WR17 Jul 2024EN

CVS settles lawsuit alleging it used AI 'lie detector' in interviews

CVS reached a tentative settlement of a proposed class action by a Massachusetts job applicant who said his 2021 HireVue video interview was analysed with Affectiva's AI to track facial expressions without notice, amounting to a lie detector test banned by state law. He could not opt out or challenge the assessment, and was not hired.

Company involved
CVS Health
AI system involved
HireVue video interview with Affectiva analysis

1 source article · read the reporting →

WF-4U7TGM1 Sep 2021

Cigna uses algorithm to deny medical claims without doctor review

Cigna, one of the largest health insurers, used an algorithm called PXDX to automatically deny medical claims. The system flagged mismatches between diagnoses and procedures, and company doctors signed off on denials in batches without reviewing patient files. One patient, Nick van Terheyden, was denied coverage for a $350 vitamin D test that his doctor had ordered. Former employees said the system saved Cigna billions of dollars but left patients with unexpected bills.

Company involved
Cigna
AI system involved
PXDX

10 source articles · read the reporting →

SiriusXM Radio faces class action on AI discrimination

The AI hiring tool screened and rejected job applicants, including the plaintiff, based on race-related data points.

Company involved
SiriusXM Radio
AI system involved
iCims

1 source article · read the reporting →

WF-0KEHNH25 Sep 2026German

Robotaxi causes accident in Dänikon – SBB and canton report property damage

Robotaxi baut Unfall in Dänikon – SBB und Kanton melden Sachschaden - Tages-Anzeiger

A robotaxi was involved in an accident in Dänikon on Friday with minor property damage. The driving system mistakenly classified a ground plate as drivable, resulting in tire damage. The Federal Roads Office confirmed that safe continued operation of the remaining vehicles is possible.

Company involved
iamo

1 source article · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

Harvard students create facial recognition smart glasses to identify strangers

Two Harvard students built a system called I-XRAY that uses Meta's Ray Ban smart glasses and the facial recognition service Pimeyes to automatically identify strangers and retrieve their personal information, including name, phone number, and home address. The students tested the system on unsuspecting people in public to demonstrate the privacy risks. They are not releasing the code.

AI system involved
I-XRAY

6 source articles · read the reporting →

WF-E6S3EX6 Jul 2020

International Baccalaureate's Secret Algorithm Downgrades Students, Jeopardising College Admissions

In July 2020, the International Baccalaureate (IB) program used a statistical model to predict final grades for over 170,000 students after cancelling exams due to Covid-19. Many students, including Anahita Nagpal, received lower-than-expected scores, causing them to lose college places and scholarships. Students, parents, and teachers questioned the fairness and transparency of the algorithm, with over 15,000 signing a petition demanding a fairer approach. IB defended the model but offered an appeals process, while some students planned to retake exams at their own expense.

Company involved
International Baccalaureate

1 source article · read the reporting →

Ryanair requires facial recognition for customers booking via online travel agents

noyb filed a complaint against Ryanair with the Spanish Data Protection Authority (AEPD) on 27 July 2023. A customer who booked a Ryanair flight through online travel agency eDreams was required to undergo a facial recognition verification process or go to the check-in counter more than two hours before departure. The customer was charged a small fee for the verification. Ryanair outsources the facial recognition to GetID. noyb alleges that the process violates GDPR because consent is not valid and the purpose is to discourage bookings through third-party agents.

Company involved
Ryanair
AI system involved
GetID

10 source articles · read the reporting →

WF-FPGDXK18 Mar 2021

Xpeng Motors Fined for Collecting Customer Facial Images Without Consent

Xpeng Motors was fined 100,000 yuan by Shanghai's market regulation authority for collecting 431,623 facial images of customers without consent. The company used surveillance cameras with facial recognition from a third-party supplier, Ulucu, to analyze customer traffic. Xpeng stated it removed the devices and deleted all data before the inspection, and that no data was leaked or misused.

Company involved
Xpeng Motors

4 source articles · read the reporting →

WF-H9X6M91 May 2020

Australian terrorism prediction tool Vera-2R flagged autism as criminality risk factor

An independent report found that the Australian government's Vera-2R terrorism risk assessment tool included autism spectrum disorders as a risk factor without empirical evidence. The tool was used to assess terrorist offenders, influencing post-sentence orders including ongoing detention. Despite the critical report being received in May 2020, the federal and NSW governments continued to use the tool. The report concluded the tool was 'extremely poor' at predicting risk.

Company involved
Department of Home Affairs
AI system involved
Vera-2R

1 source article · read the reporting →

Suresnes allows startup XXII to use CCTV for experimental surveillance algorithms

The city of Suresnes has allowed startup XXII to use its public CCTV cameras for 18 months to develop algorithms for detecting suspicious behavior. The algorithms are experimental and may have high error rates. Residents were not informed or consulted. The startup will own the data and can use the city's surveillance center as a showroom for clients.

Company involved
Mairie de Suresnes
AI system involved
XXIISmartCity

10 source articles · read the reporting →

WF-J8EHEE23 Sep 2021

Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured

On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.

Company involved
Xpeng Motors
AI system involved
NGP automatic navigation assisted driving system

1 source article · read the reporting →

WF-6RIHLC26 Jun 2025

Thomas Dexter Jakes v. Duane Youngblood (W.D. Pennsylvania): AI-hallucinated content in court filing, Monetary Sanction; Pro Hac Vice status revoked

The system generated fabricated legal citations and quotes in a court filing, misleading the court and opposing counsel.

Company involved
Tyrone A. Blackburn

1 source article · read the reporting →

WF-SRJT8X1 Dec 2016

Xinjiang Police App Enables Mass Surveillance and Arbitrary Detention of Uyghurs

Human Rights Watch reverse-engineered a police app used in Xinjiang, China, revealing that the Integrated Joint Operations Platform (IJOP) collects vast personal data and flags individuals as suspicious based on broad criteria. The system targets ethnic Uyghurs and Turkic Muslims, leading to mass arbitrary detention, forced indoctrination, and movement restrictions. The Chinese government operates the system, supplied by a subsidiary of CETC, and has not informed or obtained consent from those surveilled. The report calls for shutting down the system and releasing detainees.

Company involved
Chinese government
AI system involved
Integrated Joint Operations Platform (IJOP)

2 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

WF-60D14K1 Nov 2018

EU to trial AI lie detector at airports in Hungary, Latvia, Greece

The European Union is set to trial an AI-powered lie detector system called iBorderCtrl at airports in Hungary, Latvia and Greece. The system uses a virtual avatar to question passengers and monitors their facial expressions to detect deception. Privacy groups have raised concerns about bias and error rates, noting that the technology has only been tested on 32 people. The trial will require passenger consent and will be overseen by human guards.

Company involved
European Union (iBorderCtrl project)
AI system involved
iBorderCtrl

6 source articles · read the reporting →

WF-PWRNUQ2 Oct 2025

The People v. Raziel Ruiz Alvarez (CA California): AI-hallucinated content in court filing, Published order; monetary sanction payable by Counsel…

The AI generated fabricated legal citations that were included in a court filing, affecting the defendant's legal representation and the court's resources.

Company involved
Attorney Siddell

1 source article · read the reporting →

WF-FYG1621 Jan 2020

AI drug discovery system repurposed to generate toxic molecules in demonstration

In 2020, Collaborations Pharmaceuticals demonstrated that its AI drug discovery system, MegaSyn, could be repurposed to generate toxic molecules similar to the nerve agent VX. The company ran the software overnight and produced 40,000 potentially hazardous substances. The researchers presented their findings at a conference and briefed the White House, warning that such AI systems could be misused to create chemical weapons.

Company involved
Collaborations Pharmaceuticals
AI system involved
MegaSyn

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

Hospitals use Epic AI to predict Covid-19 decline without validation

Dozens of hospitals across the US are using Epic's deterioration index AI system to predict which Covid-19 patients will become critically ill, despite the tool not being validated for the new disease. The rapid deployment during the pandemic bypassed normal testing and validation processes.

AI system involved
Deterioration index

9 source articles · read the reporting →

WF-M3PW5F27 Aug 2026

Thomas Raynard James v. Detective Kevin Conley, et al. (S.D. Florida): AI-hallucinated content in court filing, Bar Referral

AI generated hallucinated content in a court filing, affecting the legal process and the lawyers who filed it.

1 source article · read the reporting →

WF-5M89U31 Jan 2026

Elon Musk asks X users to upload medical data to train Grok chatbot

Elon Musk has told X users to upload medical images to the platform so that the AI chatbot Grok can learn to interpret them. He claimed Grok can give medical diagnoses, sometimes better than doctors, but experts have raised concerns about accuracy and privacy. The article reports cases where Grok misread a tuberculosis case and a mammogram. xAI, which owns X, responded to Fortune: 'Legacy Media Lies.'

Company involved
X
AI system involved
Grok

6 source articles · read the reporting →

Virginia crime lab faces first challenge to secret DNA algorithm

A defendant in an armed-robbery case in Fairfax County is challenging a secret algorithm used by the Virginia crime lab to interpret DNA evidence. The lab could not make a conventional match because skin-cell DNA on the victim's shirt was mixed with DNA from too many people; the algorithm identified the defendant as a contributor. The defendant is seeking to scrutinise the algorithm, reportedly for the first time.

Company involved
Virginia crime lab

10 source articles · read the reporting →

page 1 of 2Older →