The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

164 incidents closest to “FRISS Investigations at SIU” · matched on meaning · public reporting

WF-MJJJVQ1 Jan 2023

Durham's ShotSpotter fails to detect two deadly shootings

ShotSpotter, a gunshot detection system piloted by the Durham Police Department, failed to detect two fatal shootings in February 2023, as well as a New Year's Day shooting that injured five. The system, which uses sensors and human review to alert police, did not send alerts for these incidents within its three-square-mile coverage area. The company stated it investigated and provided a report to the police, while a city official defended the pilot, noting it is still early in the year-long trial. Community concerns have been raised about increased police presence and potential racial profiling.

Company involved
Durham Police Department
AI system involved
ShotSpotter

5 source articles · read the reporting →

School AI surveillance like Gaggle can lead to false alarms, arrests

AI surveillance tools used in schools, such as Gaggle, GoGuardian and Bark, are reported to generate false alarms that have led to student arrests. The article examines cases where automated monitoring flagged innocent behaviour as threats, causing harm to students and families.

2 source articles · read the reporting →

WF-M38V6314 Nov 2024

Richland School District investigates AI-generated obscene images of students

Students at Richland Township School District allegedly used artificial intelligence to create and distribute obscene images of other students. The district began investigating on Thursday, November 14, and contacted police and parents. Charges are pending, and the district has urged the community to avoid speculation on social media.

Company involved
Richland Township School District

2 source articles · read the reporting →

WF-UF6BMA1 Jan 2018

TransUnion AI tenant screening denied 75-year-old man apartment due to mistaken littering conviction

Chris Robinson, then 75, applied for a senior living apartment in California. The property manager used an AI screening program from TransUnion, which assigned him a low score based on a mistaken conviction for littering that belonged to a different person with the same name in Texas. Robinson lost the apartment and his application fee. A federal class-action lawsuit against TransUnion moved toward a $11.5 million settlement in 2023.

10 source articles · read the reporting →

WF-R41UQV23 Feb 2012

Palantir secretly tested predictive policing in New Orleans

Beginning in 2012, Palantir Technologies secretly partnered with the New Orleans Police Department to deploy a predictive policing system. The programme analysed gang affiliations, social media and criminal histories to forecast individuals’ likelihood of committing or becoming victims of violence, operating without public knowledge or city council oversight. Researchers and law enforcement officials raised concerns about systemic bias and civil liberties. As of 2018, the city and Palantir had not disclosed the programme’s status.

Company involved
New Orleans Police Department

1 source article · read the reporting →

Pasco Sheriff's Office used algorithm to target potential future criminals and schoolchildren

The Pasco Sheriff's Office operates an intelligence-led policing programme that uses an algorithm to identify people who might break the law based on criminal histories and social networks. Deputies are sent to the homes of those flagged, even without evidence of a crime, and former deputies allege they were ordered to make targets' lives miserable. The agency also keeps a list of more than 400 schoolchildren predicted to 'fall into a life of crime', built from data such as grades and child welfare records, without informing the children or their parents. Civil liberties groups are considering lawsuits and public advocacy campaigns, and experts have called the programmes 'morally repugnant'.

Company involved
Pasco Sheriff's Office

10 source articles · read the reporting →

FBI and ICE use state driver's license photos for facial recognition without consent

The FBI and ICE have been scanning millions of Americans' driver's license photos using facial recognition technology without their knowledge or consent, according to newly released documents. The agencies accessed state DMV databases, turning them into a facial-recognition gold mine. This practice raises significant privacy concerns as it was done without public awareness or legal oversight.

Company involved
FBI and ICE

1 source article · read the reporting →

Clearview AI facial recognition app scrapes billions of images and is used by police

Clearview AI, a secretive start-up, built a facial recognition app that matches photos to a database of more than three billion images scraped from social media and websites. More than 600 law enforcement agencies, including the FBI and Department of Homeland Security, have used the tool to identify suspects in crimes such as shoplifting, identity theft and murder. The company monitored officers who ran a reporter's photo through the app, and its founder acknowledged designing an augmented-reality prototype but said there were no plans to release it. Critics warned the tool could end anonymity and enable misuse.

Company involved
Clearview AI
AI system involved
Clearview AI facial recognition app

2 source articles · read the reporting →

WF-HF1YRW1 Sep 2023

Xuhui police expand facial recognition surveillance to profile 1.1 million residents

The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.

Company involved
Shanghai Municipal Bureau of Public Security, Xuhui District Branch
AI system involved
Intelligent Image Recognition System

3 source articles · read the reporting →

WF-WPH5PP1 Feb 2025

Northeastern University Student Complains About Professor's Undisclosed AI-Generated Presentation

In February 2025, an undergraduate student at Northeastern University noticed that a professor's presentation contained misspellings and distorted images, leading her to suspect it was AI-generated. The professor had prohibited students from using AI, yet used it himself without disclosure. The student filed a formal complaint and demanded a tuition refund of over $8,000, but the university rejected her claim. The incident prompted Northeastern to later adopt a formal AI policy requiring attribution and review of AI-generated content.

Company involved
Northeastern University

2 source articles · read the reporting →

Whiteside County deputy under investigation for possible Flock camera misuse - WQAD

Whiteside County deputy under investigation for possible Flock camera misuse WQAD

Company involved
Whiteside County Sheriff's Office
AI system involved
Flock camera

1 source article · read the reporting →

WF-85J54330 Mar 2009

San Francisco Police Wrongfully Stop Woman at Gunpoint After License Plate Reader Error

On March 30, 2009, Denise Green, a 47-year-old African-American woman, was driving in San Francisco when an automatic license plate reader misread her plate as stolen. Despite discrepancies between the vehicle description and the stolen plate, officers conducted a felony stop, ordering her out at gunpoint and handcuffing her for nearly 20 minutes. Green filed a civil rights lawsuit alleging Fourth Amendment violations. The Ninth Circuit Court of Appeals reinstated her case, finding that the officers lacked reasonable suspicion for the stop.

Company involved
San Francisco Police Department

1 source article · read the reporting →

WF-DJ8Y8I20 Jan 2025

Labor unions sue Trump administration over AI social media surveillance

Three labor unions (UAW, CWA, AFT) filed a lawsuit against the U.S. Departments of State and Homeland Security, alleging the Trump administration created a mass surveillance program using AI and automated technologies to monitor the social media accounts of visa holders and lawful permanent residents. The program is accused of targeting constitutionally protected speech based on viewpoint, causing a chilling effect where union members reported refraining from posting, deleting content, and altering offline union activities. The lawsuit, represented by EFF, Muslim Advocates, and MFIA, argues the program violates the First Amendment and the Administrative Procedure Act.

Company involved
U.S. Department of State
AI system involved
Catch and Revoke

9 source articles · read the reporting →

WF-DWBKBN1 Jan 2019

Las Vegas police used unsuitable facial recognition images in nearly half of searches

The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.

Company involved
Las Vegas Metropolitan Police Department
AI system involved
Vigilant Solutions facial recognition system

1 source article · read the reporting →

WF-DYR3NM1 Jun 2021

State Farm accused of algorithmic bias against Black homeowners

A class action lawsuit filed in Chicago alleges State Farm's automated claims processing system discriminates against Black policyholders. The suit claims Black customers are more likely to face additional paperwork and longer waits for claim approval than white customers, citing data from 800 homeowners. State Farm has stated it takes the filing seriously and is committed to fair treatment, while the plaintiffs seek to enjoin the current system and require audits.

Company involved
State Farm
AI system involved
automated claims processing system

2 source articles · read the reporting →

NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged

The system made driving decisions that violated traffic safety laws, affecting other road users.

Company involved
Tesla, Inc.
AI system involved
Full Self Driving (FSD)

1 source article · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-GYY2DP5 Sep 2025

CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…

The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.

Company involved
Christopher Day

1 source article · read the reporting →

WF-0592PA9 Sep 2026

Police Investigator Accused of Making Over 4,000 Illegal Flock Camera Searches - Futurism

The system allowed unauthorized tracking of individuals' vehicles through license plate recognition, affecting five subjects including an ex-girlfriend who was searched 3,000 times.

Company involved
Albany County Sheriff's Office
AI system involved
Flock Safety ALPR

1 source article · read the reporting →

WF-WWQVJ130 Sep 2026

Two Florida deputies arrested for Flock, ALPR abuse after TCPalm query - Yahoo

The Flock ALPR system was used by deputies to track the locations of a woman and a teenage girl for personal, non-law-enforcement purposes.

Company involved
Pinellas County Sheriff's Office
AI system involved
Flock Safety ALPR

1 source article · read the reporting →

Oakland County investigating alleged misuse of Flock camera data by former deputy - WXYZ 7 News Detroit

The Flock camera system collected and stored license plate data, and a former deputy allegedly accessed it without authorization.

Company involved
Oakland County Sheriff's Office
AI system involved
Flock camera

1 source article · read the reporting →

Five Indianapolis officers charged following The Post’s reporting on Flock misuse - The Washington Post

Police officers conducted unauthorized searches on individuals' license plate data.

Company involved
Flock Safety
AI system involved
Flock

1 source article · read the reporting →

Senate hearing targets Flock Safety as officers face misuse charges - FOX 5 Atlanta

The system incorrectly linked Lindsey Isaacs's vehicle to a fatal crash scene, leading to her wrongful arrest and 13-day detention.

Company involved
Flock Safety
AI system involved
Flock Safety automated license plate reader

1 source article · read the reporting →

WF-ZV5P971 Dec 2022

Cybercheck AI tool challenged in Akron homicide cases

Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.

Company involved
Akron Police Department
AI system involved
Cybercheck

3 source articles · read the reporting →

← Newerpage 6 of 7Older →