The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Desk Officer Reporting System (DORS)” · matched on meaning · public reporting

Washington Post. . Authorities have charged or accused at least 50 law-enforcement officers of using license-plate readers for unauthorized purposes,…

The license-plate readers tracked the locations of women's vehicles, enabling officers to stalk them.

AI system involved
Flock

1 source article · read the reporting →

WF-8UAXU51 Apr 2025

New Orleans Police Secretly Used Facial Recognition to Monitor Citizens

New Orleans police secretly used Project NOLA's facial recognition cameras to automatically alert officers to possible crime suspects, potentially violating a city ordinance requiring human review and disclosure. An investigation found the system played a role in dozens of arrests but its use was often not disclosed in police reports. The program was paused in April 2025 pending a review by the police superintendent. The ACLU has called for a permanent halt, warning of threats to privacy and civil rights.

Company involved
New Orleans Police Department
AI system involved
Project NOLA

10 source articles · read the reporting →

4 Savannah officers arrested over Flock Safety misuse. What does oversight look like in Georgia? - CBS News

Automated license plate readers captured and retained data on drivers' locations.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

Another Columbus officer under investigation for Flock misuse - The Columbus Dispatch

Another Columbus officer under investigation for Flock misuse The Columbus Dispatch

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

Revere police officer used Flock system to track ex-girlfriend’s whereabouts, records show; suspended for 3 days - The Boston Globe

The Flock license plate reader system tracked Marissa Todisco's vehicle locations, which Officer Tiso accessed for personal reasons.

Company involved
Flock Safety
AI system involved
Flock camera system

1 source article · read the reporting →

WF-PUMTZ21 Aug 2024

Eastpointe officers used Flock access improperly, chief says - detroitnews.com

The system captured and allowed searching of vehicle location data, impacting the privacy of vehicle owners.

Company involved
Eastpointe Police Department
AI system involved
Flock Safety

1 source article · read the reporting →

Stockton police disclose Flock misuse, outline oversight changes after employee’s departure - Stocktonia News

Stockton police disclose Flock misuse, outline oversight changes after employee’s departure Stocktonia News

1 source article · read the reporting →

WF-A92BBP23 Jun 2026

Cherokee County deputies fired for misusing Flock licence plate database

Three deputies from the Cherokee County Sheriff’s Office in Georgia were fired and arrested for allegedly accessing the department’s automated licence plate reader database without a lawful purpose. The misuse was uncovered following a self-initiated audit of the Flock Safety system. All three individuals face charges of violation of oath of office.

Company involved
Cherokee County Sheriff’s Office
AI system involved
Flock Safety

3 source articles · read the reporting →

WF-T7JTIZ30 Sep 2026

Pinellas sheriff acknowledges gaps in Flock-style camera oversight after deputy’s arrest - tampabay28.com

The ALPR system allowed a deputy to track a woman's vehicle movements without legitimate law enforcement purpose.

Company involved
Pinellas County Sheriff's Office
AI system involved
Flock Safety ALPR

1 source article · read the reporting →

WF-NZZF5B1 Jan 2025

Two Florida deputies arrested after TCPalm's query of Flock, ALPR use - Bradenton Herald

Automated license plate readers tracked the locations of individuals, enabling deputies to stalk them without their knowledge.

AI system involved
Flock

1 source article · read the reporting →

WF-5SRSGZ1 Jan 2012

Chicago Police's Secretive Strategic Subject List Disproportionately Scores Black Men

The Chicago Police Department has used the Strategic Subject List since 2012, an algorithm that assigns risk scores to individuals based on arrest records. The list was kept secret until a court forced its release, revealing that 56% of black men aged 20-29 have a score, and only 3.6% of those on the list were involved in violence. Despite claims it is not used for enforcement, documents show it influences police deployment and arrests, leading to allegations of racial bias and lack of transparency.

Company involved
Chicago Police Department
AI system involved
Strategic Subject List

9 source articles · read the reporting →

DHS Accused of Using AI Surveillance to Track Legal Observers

Two women from Maine allege that Department of Homeland Security agents used AI-powered surveillance tools to identify them as they recorded federal immigration enforcement operations. The agents threatened to add them to a secret database of domestic terrorists, according to a lawsuit. DHS denies the existence of such a database but says it monitors threats. The lawsuit claims retaliation for exercising First Amendment rights.

Company involved
Department of Homeland Security

1 source article · read the reporting →

WF-X8XHHQ18 Jan 2024

DPD Disables AI Chatbot After It Swears at Customer and Insults Company

A customer of UK parcel delivery firm DPD was trying to track a lost package via the company's AI chatbot. The bot was unable to help and, when prompted, wrote a poem calling DPD a 'waste of time' and a 'customer's worst nightmare', and later swore at the customer. DPD acknowledged an error after a system update and disabled the AI element of the chatbot.

Company involved
DPD

2 source articles · read the reporting →

WF-CFRK5N1 Jan 2022

NYPD's ShotSpotter Gunshot Detection System Found Largely Inaccurate, Wasting Resources

An audit by the New York City Comptroller found that ShotSpotter, a gunshot detection system used by the NYPD, is overwhelmingly inaccurate. Only 13 percent of alerts in June 2023 corresponded to confirmed shootings, and the system missed over 200 real gunfire incidents in Manhattan in 2022. The NYPD has spent more than $45 million on the system since 2015. The comptroller advised against renewing the contract until the system can be fully evaluated.

Company involved
New York Police Department
AI system involved
ShotSpotter

10 source articles · read the reporting →

WF-CSZA5T20 Oct 2025

Baltimore County student handcuffed after AI gun detection system mistakes chips for firearm

A student at Kenwood High School in Essex, Maryland, was handcuffed and searched by police after an AI gun detection system misidentified his bag of Doritos as a firearm. The system, used by Baltimore County high schools, alerted law enforcement, leading officers to approach Taki Allen with guns drawn. Allen was detained and searched but no weapon was found. The school acknowledged the incident and offered counseling to affected students.

Company involved
Baltimore County Public Schools

3 source articles · read the reporting →

WF-DBUL6X20 Dec 2021

DOJ's Pattern Algorithm Shows Racial Disparities in Early Release Decisions

The U.S. Department of Justice's Pattern risk assessment algorithm, used to determine federal prisoners' eligibility for early release under the First Step Act, was found to produce racial disparities. A December 2021 DOJ report revealed that the tool overpredicted recidivism risk for Black, Hispanic, and Asian inmates, with only 7% of Black prisoners classified as minimum risk compared to 21% of white prisoners. Civil rights groups have called for the suspension of the tool, while the DOJ is working on an overhaul and reevaluating 14,000 prisoners who were misclassified.

Company involved
U.S. Department of Justice
AI system involved
Pattern

1 source article · read the reporting →

WF-H9X6M91 May 2020

Australian terrorism prediction tool Vera-2R flagged autism as criminality risk factor

An independent report found that the Australian government's Vera-2R terrorism risk assessment tool included autism spectrum disorders as a risk factor without empirical evidence. The tool was used to assess terrorist offenders, influencing post-sentence orders including ongoing detention. Despite the critical report being received in May 2020, the federal and NSW governments continued to use the tool. The report concluded the tool was 'extremely poor' at predicting risk.

Company involved
Department of Home Affairs
AI system involved
Vera-2R

1 source article · read the reporting →

WF-HM55RC24 Feb 2012

New York City Department of Education Releases Flawed Teacher Ratings Publicly

In February 2012, the New York City Department of Education publicly released individual Teacher Data Reports rating over 12,000 teachers based on value-added analysis of student test scores. The ratings, originally intended for internal use, were disclosed after a court ruled in favor of media organizations under the Freedom of Information Act. The teachers' union and education experts criticised the data as unreliable due to large margins of error and failure to account for demographic factors, warning that the release would unfairly shame or praise educators. The Department defended the ratings as a useful perspective on teacher effectiveness.

Company involved
New York City Department of Education
AI system involved
Teacher Data Reports

6 source articles · read the reporting →

Crisis Text Line shares data with for-profit spinoff Loris.ai

Crisis Text Line, a nonprofit mental health support service, uses an AI-driven chat system to collect data from conversations with people in distress. The organization shares anonymized data with its for-profit spinoff, Loris.ai, which uses it to develop customer service software. Critics raise ethical concerns about privacy and consent, though Crisis Text Line asserts the data is stripped of identifying details.

Company involved
Crisis Text Line
AI system involved
Crisis Text Line's AI-driven chat service

10 source articles · read the reporting →

WF-2YSA0H1 Apr 2020

Prisons use Verus software to scan inmate calls for coronavirus keywords

Jail and prison officials in at least three states deployed Verus, a software by LEO Technologies, to scan inmate phone calls for keywords related to COVID-19. The system transcribes and analyzes calls, flagging mentions of symptoms or the virus. Advocacy groups argue the surveillance is an abuse of privacy and could lead to retaliation against inmates raising concerns about conditions. The software is funded by Republican fundraiser Elliott Broidy and has been deployed in Georgia, Alabama, and California.

Company involved
Multiple correctional facilities in Georgia, Alabama, and California
AI system involved
Verus

10 source articles · read the reporting →

WF-USMSK71 Jul 2016

Met Police's Gang Violence Matrix accused of racial discrimination

The Metropolitan Police Service's Gang Violence Matrix, a database scoring individuals on gang involvement risk, has been accused by Amnesty International of being racially discriminatory and breaching human rights law. The matrix, set up after the 2011 London riots, holds data on about 3,800 people, with 78% being black. The Information Commissioner's Office is investigating the database.

Company involved
Metropolitan Police Service
AI system involved
Gang Violence Matrix

9 source articles · read the reporting →

WF-FSUUWV6 Apr 2018

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved
Durham Constabulary
AI system involved
Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

WF-SRJT8X1 Dec 2016

Xinjiang Police App Enables Mass Surveillance and Arbitrary Detention of Uyghurs

Human Rights Watch reverse-engineered a police app used in Xinjiang, China, revealing that the Integrated Joint Operations Platform (IJOP) collects vast personal data and flags individuals as suspicious based on broad criteria. The system targets ethnic Uyghurs and Turkic Muslims, leading to mass arbitrary detention, forced indoctrination, and movement restrictions. The Chinese government operates the system, supplied by a subsidiary of CETC, and has not informed or obtained consent from those surveilled. The report calls for shutting down the system and releasing detainees.

Company involved
Chinese government
AI system involved
Integrated Joint Operations Platform (IJOP)

2 source articles · read the reporting →

WF-NLA6I01 Jan 2012

ICO finds Met Police's Gangs Matrix breached data protection laws

The Information Commissioner's Office found that the Metropolitan Police Service's Gangs Matrix breached data protection laws, including by assigning automated harm scores to people suspected of gang involvement without proper impact assessments or safeguards. The database disproportionately affected black, Asian and minority ethnic people, and those listed had no way of knowing they were on it or challenging their inclusion. The ICO issued an enforcement notice requiring changes within six months; the Met said it would continue to use the Matrix while improving data handling.

Company involved
Metropolitan Police Service
AI system involved
Gangs Matrix

8 source articles · read the reporting →

page 1 of 2Older →