The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Mark43 OnScene” · matched on meaning · public reporting

4 Savannah officers arrested over Flock Safety misuse. What does oversight look like in Georgia? - CBS News

Automated license plate readers captured and retained data on drivers' locations.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

WF-9L2WSN4 Sep 2025

Firefighters in Manila respond to AI-generated hoax truck fire

On 4 September 2025, firefighters in Parola, Manila, responded to a report of a burning truck, only to discover the photo was AI-generated and the truck was intact. Four fire trucks from the Bureau of Fire Protection and Recto Volunteer Fire arrived at the scene. Fire chief Samuel Fenix warned that such false information endangers responders and the public, and the person responsible could face fines under the Revised Fire Code of the Philippines.

3 source articles · read the reporting →

Police Officer Uses Flock Cameras To Hand an Abuser His Victim’s Exact Location - motorbiscuit.com

The Flock camera system tracked a domestic violence victim's vehicle and disclosed her live location to her suspected abuser.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

WF-3LFPPJ25 Nov 2022

JPSO's facial recognition leads to wrongful arrest of Georgia man

The Jefferson Parish Sheriff's Office used facial recognition technology to identify Randal Reid as a suspect in a theft of luxury purses. The algorithm produced a false match, and a detective secured an arrest warrant based on it. Reid was arrested in Georgia and jailed for almost a week before the warrant was rescinded. His lawyer says the sheriff's office tacitly admitted the error.

Company involved
Jefferson Parish Sheriff's Office

1 source article · read the reporting →

WF-H4032Y19 Aug 2026ZH-TW

Driver Assistance System Leads to Rear-End Crash; Freeway Bureau Calls for Inclusion in Driving Tests and Mandatory Dealer Disclosure

輔助駕駛系統釀追撞 高公局:應納入監理考題、賣車時強制告知 - udn

A secondary rear-end collision on National Highway 1 occurred after a driver using adaptive cruise control failed to detect stationary vehicles. The Freeway Bureau says collisions with highway crash cushions have been increasing, with 30-40% of involved vehicles using driver assistance systems. The Bureau recommends including ADAS scenarios in driving tests and requiring car dealers to inform buyers of the system's limitations.

AI system involved
ACC (Adaptive Cruise Control) and ADAS

1 source article · read the reporting →

WF-NUW3U31 Jan 2021

Honolulu Police Use Robot Dog to Scan Homeless People for COVID-19

The Honolulu Police Department deployed a Boston Dynamics Spot robot to scan body temperatures of homeless residents at a state-run tent city as a COVID-19 safety measure. Civil rights advocates criticised the practice as dehumanising and invasive. The police defended the robot's use, stating it protected officers and shelter staff. The incident sparked debate over police use of robotic technology.

Company involved
Honolulu Police Department
AI system involved
Spot

4 source articles · read the reporting →

WF-7N8YEU1 Feb 2024

Iraq War Veteran Claims Flock Camera Error Led to Police Stop at Gunpoint - Military.com

The system incorrectly identified a vehicle as stolen, leading to a traffic stop and detention of the driver at gunpoint.

Company involved
Flock Safety
AI system involved
Flock Safety license plate reader

1 source article · read the reporting →

WF-6F2H441 Oct 2017

ShotSpotter Missed 47% of Gunshot Victims in Chicago Police Data

Between October 2017 and July 2018, a Chicago police analyst tracked ShotSpotter's accuracy in the 10th district and found it correctly detected only 63 of 135 shootings where a person was struck, a 47% rate. The analyst shared the findings with CPD and ShotSpotter, and the company installed additional sensors, but accuracy remained below 50%. Despite this, the city signed a $33 million contract extension. SoundThinking says the system meets performance guarantees and has helped locate hundreds of victims.

Company involved
Chicago Police Department
AI system involved
ShotSpotter

1 source article · read the reporting →

WF-5SRSGZ1 Jan 2012

Chicago Police's Secretive Strategic Subject List Disproportionately Scores Black Men

The Chicago Police Department has used the Strategic Subject List since 2012, an algorithm that assigns risk scores to individuals based on arrest records. The list was kept secret until a court forced its release, revealing that 56% of black men aged 20-29 have a score, and only 3.6% of those on the list were involved in violence. Despite claims it is not used for enforcement, documents show it influences police deployment and arrests, leading to allegations of racial bias and lack of transparency.

Company involved
Chicago Police Department
AI system involved
Strategic Subject List

9 source articles · read the reporting →

WF-BCCWD613 Sep 2022

Serve Robotics delivery robot crosses police crime scene after human operator error

A Serve Robotics sidewalk delivery robot crossed yellow caution tape and entered a crime scene in Los Angeles after a human operator remotely took control and decided to proceed when bystanders lifted the tape. The company acknowledged the error, stating the robot's autonomous system would not have crossed on its own. Serve Robotics is implementing new protocols and software updates to prevent similar incidents in the future.

Company involved
Serve Robotics
AI system involved
sidewalk delivery robot

2 source articles · read the reporting →

WF-C2SBHV4 Jan 2026

AI-Generated Fake Photo of Orlando West High School Fire Causes Outrage and EMS Warning

A fake AI-generated photo depicting Orlando West High School in Soweto on fire was circulated online, prompting an investigation by Johannesburg Emergency Management Services. EMS spokesperson Kagiso Phasha confirmed the image was a hoax and warned that such pranks cause unnecessary expenditure and divert critical resources. The incident has sparked outrage and a stern warning that those responsible will face legal consequences.

2 source articles · read the reporting →

WF-ZJ5ED23 Oct 2025

U.S. Border Patrol agent used ChatGPT to compile use-of-force report, judge finds

A U.S. Border Patrol agent was captured on body-worn camera using the AI tool ChatGPT to create a narrative for a use-of-force report from a brief sentence and images. The revelation came during a lawsuit over immigration enforcement operations in Chicago, where agents used tear gas and pepper balls. U.S. District Judge Sara Ellis found the use of ChatGPT undermined the reports’ credibility, contributing to an inaccuracy finding. The judge issued a preliminary injunction restricting chemical munitions, later stayed by the 7th Circuit Court of Appeals pending appeal.

Company involved
U.S. Border Patrol
AI system involved
ChatGPT

1 source article · read the reporting →

WF-CFRK5N1 Jan 2022

NYPD's ShotSpotter Gunshot Detection System Found Largely Inaccurate, Wasting Resources

An audit by the New York City Comptroller found that ShotSpotter, a gunshot detection system used by the NYPD, is overwhelmingly inaccurate. Only 13 percent of alerts in June 2023 corresponded to confirmed shootings, and the system missed over 200 real gunfire incidents in Manhattan in 2022. The NYPD has spent more than $45 million on the system since 2015. The comptroller advised against renewing the contract until the system can be fully evaluated.

Company involved
New York Police Department
AI system involved
ShotSpotter

10 source articles · read the reporting →

WF-CSZA5T20 Oct 2025

Baltimore County student handcuffed after AI gun detection system mistakes chips for firearm

A student at Kenwood High School in Essex, Maryland, was handcuffed and searched by police after an AI gun detection system misidentified his bag of Doritos as a firearm. The system, used by Baltimore County high schools, alerted law enforcement, leading officers to approach Taki Allen with guns drawn. Allen was detained and searched but no weapon was found. The school acknowledged the incident and offered counseling to affected students.

Company involved
Baltimore County Public Schools

3 source articles · read the reporting →

WF-MAV6WL14 Dec 2025

xAI's Grok Chatbot Spreads Misinformation About Bondi Beach Shooting

On 14 December 2025, xAI's Grok chatbot was found to be generating false and misleading information in response to user queries about the Bondi Beach shooting. The AI misidentified a video of a bystander disarming the shooter, claimed a photo of the injured bystander was of an Israeli hostage, and confused the event with other incidents. xAI responded to a request for comment with an automated message saying 'Legacy Media Lies,' and the glitch remained unresolved.

Company involved
xAI
AI system involved
Grok

3 source articles · read the reporting →

WF-GR7YCJ7 Nov 2025

Baltimore County Schools Relocate Students After AI Gun False Alarm

On November 7, 2025, an AI security system called Omnilert reported a possible gun at Parkville High School in Baltimore County, Maryland. Students were relocated while police searched the school, but no threat was found. The incident follows a similar false alarm at Kenwood High School in October, where Omnilert mistook a bag of chips for a gun, leading to students being handcuffed. Baltimore County Public Schools has promised annual training on protocols for responding to Omnilert alerts.

Company involved
Baltimore County Public Schools
AI system involved
Omnilert

1 source article · read the reporting →

WF-NCRTFN1 Jan 2020

Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons

Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.

Company involved
Lockport City School District
AI system involved
AEGIS

1 source article · read the reporting →

WF-FSUUWV6 Apr 2018

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved
Durham Constabulary
AI system involved
Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

WF-FD3HLB1 Jul 2013

Chicago PD predictive policing program led to man being shot twice

In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.

Company involved
Chicago Police Department
AI system involved
heat list

10 source articles · read the reporting →

Police facial recognition robot identifies anger and distress

A police facial recognition robot identifies anger and distress. The article gives no further details about the system, its deployment, or any consequences.

8 source articles · read the reporting →

WF-IX821Q20 Mar 2022

Alonzo Sawyer falsely arrested after face recognition misidentification by Maryland Transit Police

Alonzo Sawyer was arrested in spring 2022 after an intelligence analyst using face recognition software identified him as a possible match for a bus assault suspect. He spent nine days in jail before the actual suspect was identified by the victim. His wife Carronne Sawyer advocated for his release and later testified in support of proposed Maryland legislation to regulate police use of face recognition. The incident is one of several known false arrests of Black men due to face recognition errors.

Company involved
Maryland Transit Administration Police

6 source articles · read the reporting →

WF-N16FBJ1 Oct 2022

Israeli military uses Smash Hopper turret against Palestinian protesters

The Israeli military deployed Smash Hopper remote-controlled gun turrets in the West Bank. The turrets fire stun grenades, less-than-lethal bullets, and tear gas at Palestinian protesters without warning. The systems were observed at Al-Aroub refugee camp and Hebron in October 2022. The Smash Hopper is produced by Smart Shooter.

Company involved
Israeli military
AI system involved
Smash Hopper

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

WF-HKRG5R7 Jul 2017

Hamburg deployed mass surveillance for G20 Summit

The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.

Company involved
Senate of Hamburg

10 source articles · read the reporting →

page 1 of 2Older →