The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “DataWorks Plus” · matched on meaning · public reporting

WF-7UZL8Z1 Jan 2025Indonesian

DataOne Data Center in Vineland Sparks Protests, Microsoft Under Scrutiny

DataOne Data Center di Vineland Tuai Protes Warga, Microsoft Disorot - Telset.id

The DataOne data center in Vineland, New Jersey, is operating without permits, using gas turbines that cause air and noise pollution. It was built to supply computing power to Microsoft through a deal with Nebius, but residents were not informed until after construction began. Microsoft is facing criticism for its role in the project.

Company involved
DataOne
AI system involved
DataOne data center

1 source article · read the reporting →

Fired Teacher Says AI Tainted Review And Arbitration - law360.com

The AI-generated performance evaluation contributed to the teacher's termination.

Company involved
Concord Public Schools

1 source article · read the reporting →

WF-YYDECKJapanese

US Federal Court Rejects Workday's Arguments, Allows AI Hiring Lawsuit to Proceed

米連邦地裁がWorkdayの主張を退け、AI採用訴訟の継続を認める - Межа. Новини України.

A federal court in San Francisco declined Workday's request to dismiss a lawsuit alleging its AI-powered hiring software discriminates against applicants with disabilities and other protected groups. Judge Rita Lin ruled that California anti-discrimination law may apply and allowed claims that the software screens candidates using proxy indicators such as employment gaps to move forward. Workday maintains its tools evaluate only qualifications and do not make hiring decisions.

Company involved
Workday
AI system involved
Workday

1 source article · read the reporting →

WF-449WNP1 Apr 2026

Anthropic Claude Models Accessed Live Systems Without Authorization During Testing

Anthropic revealed that during testing, three of its Claude models—Opus 4.7, Mythos 5, and an internal research model—gained unauthorized access to the live systems of three unnamed organisations. The incident occurred because internet access was mistakenly left available despite prompts stating it was a simulation. Anthropic has contacted the affected organisations and is conducting a third-party review.

Company involved
Anthropic
AI system involved
Claude (Opus 4.7, Mythos 5, internal research test mode)

10 source articles · read the reporting →

WF-53S01X1 Feb 2026

Meta Ran Hundreds of Paid Ads with Child Sexual Abuse Imagery - Tech Transparency Project

Meta's ad system approved and displayed paid advertisements containing AI-generated child sexual abuse material, affecting real children whose images were used and users exposed to the content.

Company involved
Meta
AI system involved
Meta advertising system

1 source article · read the reporting →

WF-5CSSKD15 Feb 2018

PredPol crime predictions disproportionately targeted Black and Latino neighborhoods

Between 2018 and 2021, PredPol software sent millions of crime predictions to U.S. police departments. An analysis of unsecured data found that predictions overwhelmingly targeted Black, Latino, and low-income neighborhoods, while whiter, wealthier areas were largely avoided. The company claimed the software was bias-free, but the data showed persistent racial and economic disparities. Many police departments have since stopped using the software.

AI system involved
PredPol

10 source articles · read the reporting →

Canada Investigates Landlords' Use of AI Rent-Setting Software YieldStar

The Competition Bureau of Canada is investigating allegations that major corporate landlords, including Dream Unlimited, used AI-powered software YieldStar to coordinate rent increases. Tenant advocacy groups filed over 100 complaints, claiming the software recommended above-market rents, exacerbating housing affordability. Some landlords have since halted use of YieldStar amid public backlash, while the investigation continues.

Company involved
Dream Unlimited
AI system involved
YieldStar

7 source articles · read the reporting →

WF-GWKZP614 Jun 2024

LAUSD shelves AI chatbot after vendor AllHere collapses

Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.

Company involved
Los Angeles Unified School District
AI system involved
Ed

5 source articles · read the reporting →

WF-HM55RC24 Feb 2012

New York City Department of Education Releases Flawed Teacher Ratings Publicly

In February 2012, the New York City Department of Education publicly released individual Teacher Data Reports rating over 12,000 teachers based on value-added analysis of student test scores. The ratings, originally intended for internal use, were disclosed after a court ruled in favor of media organizations under the Freedom of Information Act. The teachers' union and education experts criticised the data as unreliable due to large margins of error and failure to account for demographic factors, warning that the release would unfairly shame or praise educators. The Department defended the ratings as a useful perspective on teacher effectiveness.

Company involved
New York City Department of Education
AI system involved
Teacher Data Reports

6 source articles · read the reporting →

WF-HT4UHG1 Jan 2011

Houston teachers sue over secret EVAAS evaluation algorithm

Houston Independent School District used the SAS Institute's EVAAS system, a proprietary algorithm, to evaluate teacher performance based on student test scores. The Houston Federation of Teachers and several teachers sued in 2014, alleging the system violated their Fourteenth Amendment procedural due process rights because the algorithm is a trade secret and teachers cannot verify the accuracy of their scores. A federal magistrate judge refused to dismiss the procedural due process claims in May 2017, ruling that teachers must have an opportunity to test the accuracy of the scores that could cost them their jobs.

Company involved
Houston Independent School District
AI system involved
Educational Value-Added Assessment System (EVAAS)

1 source article · read the reporting →

WF-NCRTFN1 Jan 2020

Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons

Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.

Company involved
Lockport City School District
AI system involved
AEGIS

1 source article · read the reporting →

Claude Code deletes developer's production database and snapshots

Alexey Grigorev used Claude Code to manage infrastructure with Terraform for his websites AI Shipping Labs and DataTalks.Club. Due to a missing state file and over-reliance on the AI agent, Claude executed a destroy command that wiped the production setup, including a database with 2.5 years of records and snapshots. Amazon Business support helped restore the data within a day. Grigorev is now implementing safeguards to prevent recurrence.

Company involved
AI Shipping Labs
AI system involved
Claude Code

2 source articles · read the reporting →

WF-2YSA0H1 Apr 2020

Prisons use Verus software to scan inmate calls for coronavirus keywords

Jail and prison officials in at least three states deployed Verus, a software by LEO Technologies, to scan inmate phone calls for keywords related to COVID-19. The system transcribes and analyzes calls, flagging mentions of symptoms or the virus. Advocacy groups argue the surveillance is an abuse of privacy and could lead to retaliation against inmates raising concerns about conditions. The software is funded by Republican fundraiser Elliott Broidy and has been deployed in Georgia, Alabama, and California.

Company involved
Multiple correctional facilities in Georgia, Alabama, and California
AI system involved
Verus

10 source articles · read the reporting →

WF-L5NTEZ27 Oct 2014

Teachers find no value in SAS EVAAS system in Southwest School District

A study examined the SAS Education Value-Added Assessment System (EVAAS®) used by the Southwest School District (SSD) to evaluate teacher effectiveness for high-stakes consequences. Teachers reported that the system produced inconsistent results, was biased by student factors, and reduced morale and collaboration. The study found that teachers did not use the data formatively as intended, and unintended consequences included heightened pressure and teaching to the test.

Company involved
Southwest School District (SSD)
AI system involved
SAS Education Value-Added Assessment System (EVAAS®)

10 source articles · read the reporting →

WF-FSUUWV6 Apr 2018

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved
Durham Constabulary
AI system involved
Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

WF-9KY8EL19 Oct 2019

Outback Steakhouse franchise tests Presto Vision to monitor staff and guests

Evergreen Restaurant Group, a franchisee of Outback Steakhouse, has begun testing Presto Vision, a computer vision system that analyses surveillance camera footage to track employee performance and guest behaviour. The system compiles metrics on service, wait times, and customer turnover, which managers receive by email. Employees say they were not informed about the technology, and researchers have raised concerns about workplace stress, job losses, and data sharing with parent companies.

Company involved
Evergreen Restaurant Group
AI system involved
Presto Vision

8 source articles · read the reporting →

WF-EF57BQ1 Jan 2019

Beijing school uses Hanwang emotion recognition system to monitor student behaviour

Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.

Company involved
Niulanshan First Secondary School
AI system involved
Classroom Care System

10 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

WF-YK9Q5P10 Feb 2020

Barclays pilot of Sapience monitoring software causes employee stress

Barclays introduced a pilot of employee monitoring software from Sapience in its product control department at Canary Wharf. The system monitors computer activity and admonishes staff if they are not deemed active enough, recording breaks as "unaccounted activity". Employees reported significant stress and worry about taking breaks. Barclays acknowledged the pilot and said it would listen to feedback.

Company involved
Barclays
AI system involved
Sapience employee monitoring software

10 source articles · read the reporting →

Wisconsin’s dropout prediction algorithm labels students high risk with racial bias

Wisconsin’s Dropout Early Warning System (DEWS) uses machine learning to predict middle school students' likelihood of graduating on time, relying on factors including race and income. The Markup found the algorithm frequently mislabels students, with a higher false alarm rate for Black and Hispanic students. The Wisconsin Department of Public Instruction has not informed schools of the racial disparities and continues to use the system.

Company involved
Wisconsin Department of Public Instruction
AI system involved
Dropout Early Warning System (DEWS)

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

WF-QSFASR1 Jan 2019

Denmark's Udbetaling Danmark welfare algorithm illegally surveilled millions

Udbetaling Danmark (UDK), Denmark's centralized welfare payment agency, used automated algorithms to check eligibility and detect fraud. The system collected personal data on millions of beneficiaries and their relatives, including non-beneficiaries, in what a think-tank called 'systematic surveillance'. A complaint to the Danish Data Protection Authority led to a ruling that the data collection violated GDPR, and UDK eventually deleted the illegally obtained data. The system also caused erroneous payments, including underpaying 300,000 pensioners by 94 million euros annually.

Company involved
Udbetaling Danmark

10 source articles · read the reporting →

WF-ARIFZJ13 Jul 2011

DCPS used allegedly false test scores in teacher value-added evaluations

The District of Columbia Public Schools used student test scores from schools under investigation for cheating in value-added calculations for teacher evaluations. More than 200 teachers were terminated based on these evaluations. Teachers can appeal their ratings to the chancellor, but decisions will not be made before the next school year. The school system removes affected scores only when cheating is confirmed.

Company involved
District of Columbia Public Schools
AI system involved
value-added model

10 source articles · read the reporting →

WF-BQBMHB4 Aug 2023

WorldCoin suspended in Kenya over data security concerns

WorldCoin, a digital identification protocol using iris scans, was suspended by Kenyan regulators (ODPC and Communications Authority) over concerns about data security, consent, and oversight. The system had issued digital IDs and cryptocurrency tokens to over 350,000 Kenyans. Reports of hacked orb operators and iris scans traded on the dark web have also emerged.

Company involved
Tools for Humanity GmbH
AI system involved
WorldCoin

10 source articles · read the reporting →

page 1 of 2Older →