The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

212 incidents closest to “Tabular Review” · matched on meaning · public reporting

Virginia courts' use of algorithms raises fairness concerns

The Washington Post considers the use of risk-assessment algorithms in Virginia's courts, which were introduced to make judicial decisions fairer. The analysis finds that the outcomes have been far more complicated than expected, raising concerns about the system's fairness. The algorithms affect potentially many criminal defendants across the state.

Company involved
Virginia court system

7 source articles · read the reporting →

WF-2PVWQU31 May 2026

CBSE OnMark portal vulnerability exposed student data to Google Gemini

A 19-year-old ethical hacker, Nisarga Adhikary, claimed to have hacked the CBSE's digital evaluation ecosystem, revealing that personal information of students was processed by Google's Gemini in automation scripts. The Central Board of Secondary Education (CBSE) stated on May 31, 2026, that the identified vulnerabilities had been contained and other exploitable weaknesses were being ruled out. The board expressed gratitude to alert citizens and ethical hackers who pointed out the weaknesses. No actual data breach was confirmed, but the incident raised concerns about student privacy.

Company involved
Central Board of Secondary Education (CBSE)
AI system involved
OnMark

1 source article · read the reporting →

Meta's cross-check program delays removal of violating content for privileged users

The Oversight Board's policy advisory opinion on Meta's cross-check program found that the system grants certain users, such as business partners and celebrities, additional human review before removing violating content, while ordinary users face immediate removal. This unequal treatment allows potentially harmful content to remain on the platform for days, and Meta has failed to track whether the program improves accuracy. The Board made 32 recommendations to address these flaws.

Company involved
Meta
AI system involved
cross-check program

10 source articles · read the reporting →

Audit of RisCanvi finds biases and reliability issues in criminal justice system

Eticas conducted an adversarial audit of RisCanvi, an AI risk assessment tool used in Catalonia's criminal justice system. The audit uncovered biases in risk classifications against specific demographics and significant reliability issues. The findings call for fairer practices in criminal justice AI.

Company involved
Catalonia's criminal justice system
AI system involved
RisCanvi

4 source articles · read the reporting →

Thomson Reuters wins copyright lawsuit against AI startup Ross Intelligence

In 2020, Thomson Reuters filed a copyright lawsuit against legal AI startup Ross Intelligence, alleging that Ross reproduced materials from its Westlaw legal research service. In February 2025, a US District Court judge ruled in Thomson Reuters' favor, finding that Ross infringed copyright and that fair use did not apply. Ross Intelligence had shut down in 2021 due to litigation costs.

Company involved
Ross Intelligence
AI system involved
Ross Intelligence

4 source articles · read the reporting →

WF-1UJHJB1 Jan 2019

Tennessee's TennCare Connect algorithm illegally denied thousands Medicaid benefits

A U.S. District Court judge ruled that Tennessee's TennCare Connect system, built by Deloitte for over $400 million, illegally denied thousands of low-income residents and people with disabilities Medicaid and disability benefits due to programming and data errors. The system automatically terminated coverage without properly considering eligibility for all available programs. A class action lawsuit filed in 2020 resulted in the ruling.

Company involved
TennCare (Tennessee Medicaid)
AI system involved
TennCare Connect

10 source articles · read the reporting →

Mass claim against TikTok for privacy violations and child data protection

A Dutch foundation, SOMI, has launched a mass claim against TikTok, alleging that the platform collects personal data from users, including children, without proper consent. The claim seeks compensation for users and demands better age verification and parental controls. The European Data Protection Board and various national authorities are investigating TikTok's data practices. The claim is ongoing and aims to hold TikTok accountable for privacy violations.

Company involved
TikTok
AI system involved
TikTok

10 source articles · read the reporting →

WF-OP475C1 Jan 2018

Dutch probation service's OXREC algorithm flawed, leading to incorrect recidivism risk assessments

The Dutch Inspectorate of Justice and Security (Inspectie JenV) published a report finding that the probation service's (Reclassering) OXREC algorithm contains serious flaws, including swapped formulas and incorrect numbers, causing about a quarter of risk assessments to be wrong. The algorithm, used since 2018 for about 44,000 cases per year, also uses variables that can lead to discrimination, such as neighborhood score and income. The Inspectorate recommended immediate correction or temporary suspension. The probation service announced it would temporarily stop using OXREC.

Company involved
Reclassering Nederland
AI system involved
OXREC

4 source articles · read the reporting →

WF-4NBY2U13 May 2024

NHTSA investigation PE24016: Unexpected ADS behavior

Waymo's automated driving system exhibited unexpected behavior during driving.

Company involved
Waymo

1 source article · read the reporting →

Samsung settles Texas lawsuit over ACR data collection on smart TVs

Samsung has settled a lawsuit with the Texas Attorney General over its Automated Content Recognition (ACR) system on smart TVs. The system collected viewing data from users without informed consent. As part of the settlement, Samsung agreed to stop collecting ACR data from Texans without explicit consent and to rewrite its privacy prompts. Samsung also faces a federal class action in New York over similar allegations.

Company involved
Samsung
AI system involved
Automated Content Recognition (ACR)

7 source articles · read the reporting →

WF-04R0261 Sep 2015

Princeton Review charges higher SAT prep fees to Asian Americans

A ProPublica study found that Princeton Review's geographically-determined pricing system charges Asian American students almost twice as likely as other ethnicities to pay the highest prices for online SAT tutoring. The system sets prices based on location, with higher prices in areas like New York City where Asian Americans are concentrated. Princeton Review stated that prices reflect local costs and competition, but the disparity raises concerns about racial discrimination in automated pricing.

Company involved
Princeton Review

7 source articles · read the reporting →

WF-1YTNE61 Jan 2026

New Records Show Medicare WISeR AI Prior Authorization Model Causing Inappropriate Denials of Care - Medicare Rights Center

The system denied or delayed prior authorization for medical procedures, affecting Medicare beneficiaries in six states.

Company involved
Centers for Medicare & Medicaid Services
AI system involved
WISeR

1 source article · read the reporting →

ChatGPT 4o image generator used to create fake receipts

ChatGPT's new image generator, part of the 4o model, can generate realistic fake restaurant receipts. Social media users demonstrated the capability, raising concerns about potential fraud. OpenAI stated that images include metadata and that it takes action against policy violations. The company defended the feature as allowing creative freedom.

Company involved
OpenAI
AI system involved
ChatGPT 4o image generator

5 source articles · read the reporting →

WF-333WY81 May 2025

Philip Morris accused of using AI to rig EU tobacco consultation responses

Dutch broadcasters Pointer and NOS allege that Philip Morris International used an AI-powered platform, 'Your Voice, Your Choice', to generate responses to the European Commission's public consultation on tobacco legislation. The platform offered pre-defined responses and AI assistance, leading to an estimated 30 per cent of all responses being AI-generated. Philip Morris denies wrongdoing, stating that users retained full control and that anti-tobacco lobbyists are attempting to discredit legitimate participation. The incident raises concerns about the integrity of EU democratic processes.

Company involved
Philip Morris International
AI system involved
Your Voice, Your Choice

4 source articles · read the reporting →

WF-UF6BMA1 Jan 2018

TransUnion AI tenant screening denied 75-year-old man apartment due to mistaken littering conviction

Chris Robinson, then 75, applied for a senior living apartment in California. The property manager used an AI screening program from TransUnion, which assigned him a low score based on a mistaken conviction for littering that belonged to a different person with the same name in Texas. Robinson lost the apartment and his application fee. A federal class-action lawsuit against TransUnion moved toward a $11.5 million settlement in 2023.

10 source articles · read the reporting →

WF-Q6RGYB1 Nov 2021

DWP suspends benefits for Bulgarian nationals using risk review system

The Department for Work and Pensions (DWP) used a 'risk review' unit to suspend universal credit benefits for dozens of Bulgarian nationals, many of whom are single mothers working part-time. The suspensions were made without explanation, leaving claimants without income, forcing some to use food banks and face eviction. An MP raised concerns that the system unfairly targets claimants based on their nationality, but the DWP denied the allegations, stating the risk review team investigates potential criminal activity and is not linked to nationality.

Company involved
Department for Work and Pensions

6 source articles · read the reporting →

WF-ULS6R81 Mar 2025

Senators demand review of VA's AI-driven contract cancellations

The Department of Veterans Affairs used an AI tool created by a Department of Government Efficiency employee to identify hundreds of contracts for cancellation. Senators Richard Blumenthal and Angus King have called for the VA Inspector General to investigate the use of AI in these decisions, alleging that the tool used flawed formulas and that the cancellations are harming veterans by cutting services. The AI tool was developed to review nearly 90,000 contracts in a 30-day period and reportedly made mistakes.

Company involved
Department of Veterans Affairs

8 source articles · read the reporting →

WF-7PPBNA4 Mar 2022

Spanish VioGén Algorithm Deems Woman Low Risk Before Fatal Domestic Violence

In January 2022, Lobna Hemid reported her husband's abuse to Spanish police. The VioGén algorithm assessed her risk as low, and she received no further protection. Seven weeks later, her husband fatally stabbed her. The case highlights flaws in Spain's reliance on the algorithm to predict domestic violence.

Company involved
Interior Ministry of Spain
AI system involved
VioGén

2 source articles · read the reporting →

Ninth Circuit Sanctions Attorneys Over AI-Hallucinated Legal Briefs

The Ninth Circuit sanctioned immigration attorneys from Sethi Law Group after they filed briefs containing AI-generated false cases and quotations. The court imposed monetary sanctions, a six-month suspension from Ninth Circuit practice, and referred the matter to the California State Bar. The court also required future filings to disclose AI use and certify that all citations were verified. The case is Lnu v. Blanche.

Company involved
Sethi Law Group

2 source articles · read the reporting →

WF-CBSEF51 Jan 2017

VA's Suicide Prevention Algorithm Favours Men, Ignores Sexual Trauma

The Department of Veterans Affairs' REACH VET algorithm, designed to identify veterans at high risk of suicide, reportedly prioritises white men and excludes factors like military sexual trauma that disproportionately affect women. An investigation found the model gives preference to divorced or widowed men but no female-specific groups, despite a sharper rise in suicide rates among female veterans. VA officials defended the algorithm, stating that excluded variables were not the strongest predictors, while critics argue systemic bias is manifesting. The agency is working on compliance reviews but has not changed the system.

Company involved
Department of Veterans Affairs
AI system involved
REACH VET

2 source articles · read the reporting →

WF-DC7W6F1 Aug 2022

Hospital Denies Pain Medication to Patient Based on Narx Score

Elizabeth Amirault, a 34-year-old chronic pain patient, was denied narcotic pain medication during a hospital visit in Fort Wayne, Indiana, in August 2022. A nurse practitioner told her that her Narx Score, generated by Bamboo Health's NarxCare platform, was too high to prescribe opioids. The algorithm uses prescription drug monitoring data to assess risk of misuse, but critics say it can harm patients by cutting off needed care. Amirault believes her score was unfairly high due to her multiple surgeries and doctors.

AI system involved
NarxCare

3 source articles · read the reporting →

NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged

The system made driving decisions that violated traffic safety laws, affecting other road users.

Company involved
Tesla, Inc.
AI system involved
Full Self Driving (FSD)

1 source article · read the reporting →

WF-GYY2DP5 Sep 2025

CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…

The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.

Company involved
Christopher Day

1 source article · read the reporting →

WF-1OVEQM23 Sep 2026

OpenAI sued over alleged undisclosed human review of ChatGPT conversations - Top Class Actions

ChatGPT conversations were reviewed by third-party contractors without adequate disclosure to users.

Company involved
OpenAI OpCo LLC
AI system involved
ChatGPT

1 source article · read the reporting →

← Newerpage 8 of 9Older →