4 Savannah officers arrested over Flock Safety misuse. What does oversight look like in Georgia? - CBS News
Automated license plate readers captured and retained data on drivers' locations.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety
1 source article · read the reporting →
Firefighters in Manila respond to AI-generated hoax truck fire
On 4 September 2025, firefighters in Parola, Manila, responded to a report of a burning truck, only to discover the photo was AI-generated and the truck was intact. Four fire trucks from the Bureau of Fire Protection and Recto Volunteer Fire arrived at the scene. Fire chief Samuel Fenix warned that such false information endangers responders and the public, and the person responsible could face fines under the Revised Fire Code of the Philippines.
3 source articles · read the reporting →
Police Officer Uses Flock Cameras To Hand an Abuser His Victim’s Exact Location - motorbiscuit.com
The Flock camera system tracked a domestic violence victim's vehicle and disclosed her live location to her suspected abuser.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety
1 source article · read the reporting →
JPSO's facial recognition leads to wrongful arrest of Georgia man
The Jefferson Parish Sheriff's Office used facial recognition technology to identify Randal Reid as a suspect in a theft of luxury purses. The algorithm produced a false match, and a detective secured an arrest warrant based on it. Reid was arrested in Georgia and jailed for almost a week before the warrant was rescinded. His lawyer says the sheriff's office tacitly admitted the error.
- Company involved
- Jefferson Parish Sheriff's Office
1 source article · read the reporting →
Driver Assistance System Leads to Rear-End Crash; Freeway Bureau Calls for Inclusion in Driving Tests and Mandatory Dealer Disclosure
輔助駕駛系統釀追撞 高公局:應納入監理考題、賣車時強制告知 - udn
A secondary rear-end collision on National Highway 1 occurred after a driver using adaptive cruise control failed to detect stationary vehicles. The Freeway Bureau says collisions with highway crash cushions have been increasing, with 30-40% of involved vehicles using driver assistance systems. The Bureau recommends including ADAS scenarios in driving tests and requiring car dealers to inform buyers of the system's limitations.
- AI system involved
- ACC (Adaptive Cruise Control) and ADAS
1 source article · read the reporting →
Honolulu Police Use Robot Dog to Scan Homeless People for COVID-19
The Honolulu Police Department deployed a Boston Dynamics Spot robot to scan body temperatures of homeless residents at a state-run tent city as a COVID-19 safety measure. Civil rights advocates criticised the practice as dehumanising and invasive. The police defended the robot's use, stating it protected officers and shelter staff. The incident sparked debate over police use of robotic technology.
- Company involved
- Honolulu Police Department
- AI system involved
- Spot
4 source articles · read the reporting →
Iraq War Veteran Claims Flock Camera Error Led to Police Stop at Gunpoint - Military.com
The system incorrectly identified a vehicle as stolen, leading to a traffic stop and detention of the driver at gunpoint.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety license plate reader
1 source article · read the reporting →
ShotSpotter Missed 47% of Gunshot Victims in Chicago Police Data
Between October 2017 and July 2018, a Chicago police analyst tracked ShotSpotter's accuracy in the 10th district and found it correctly detected only 63 of 135 shootings where a person was struck, a 47% rate. The analyst shared the findings with CPD and ShotSpotter, and the company installed additional sensors, but accuracy remained below 50%. Despite this, the city signed a $33 million contract extension. SoundThinking says the system meets performance guarantees and has helped locate hundreds of victims.
- Company involved
- Chicago Police Department
- AI system involved
- ShotSpotter
1 source article · read the reporting →
Chicago Police's Secretive Strategic Subject List Disproportionately Scores Black Men
The Chicago Police Department has used the Strategic Subject List since 2012, an algorithm that assigns risk scores to individuals based on arrest records. The list was kept secret until a court forced its release, revealing that 56% of black men aged 20-29 have a score, and only 3.6% of those on the list were involved in violence. Despite claims it is not used for enforcement, documents show it influences police deployment and arrests, leading to allegations of racial bias and lack of transparency.
- Company involved
- Chicago Police Department
- AI system involved
- Strategic Subject List
9 source articles · read the reporting →
Serve Robotics delivery robot crosses police crime scene after human operator error
A Serve Robotics sidewalk delivery robot crossed yellow caution tape and entered a crime scene in Los Angeles after a human operator remotely took control and decided to proceed when bystanders lifted the tape. The company acknowledged the error, stating the robot's autonomous system would not have crossed on its own. Serve Robotics is implementing new protocols and software updates to prevent similar incidents in the future.
- Company involved
- Serve Robotics
- AI system involved
- sidewalk delivery robot
2 source articles · read the reporting →
AI-Generated Fake Photo of Orlando West High School Fire Causes Outrage and EMS Warning
A fake AI-generated photo depicting Orlando West High School in Soweto on fire was circulated online, prompting an investigation by Johannesburg Emergency Management Services. EMS spokesperson Kagiso Phasha confirmed the image was a hoax and warned that such pranks cause unnecessary expenditure and divert critical resources. The incident has sparked outrage and a stern warning that those responsible will face legal consequences.
2 source articles · read the reporting →
U.S. Border Patrol agent used ChatGPT to compile use-of-force report, judge finds
A U.S. Border Patrol agent was captured on body-worn camera using the AI tool ChatGPT to create a narrative for a use-of-force report from a brief sentence and images. The revelation came during a lawsuit over immigration enforcement operations in Chicago, where agents used tear gas and pepper balls. U.S. District Judge Sara Ellis found the use of ChatGPT undermined the reports’ credibility, contributing to an inaccuracy finding. The judge issued a preliminary injunction restricting chemical munitions, later stayed by the 7th Circuit Court of Appeals pending appeal.
- Company involved
- U.S. Border Patrol
- AI system involved
- ChatGPT
1 source article · read the reporting →
NYPD's ShotSpotter Gunshot Detection System Found Largely Inaccurate, Wasting Resources
An audit by the New York City Comptroller found that ShotSpotter, a gunshot detection system used by the NYPD, is overwhelmingly inaccurate. Only 13 percent of alerts in June 2023 corresponded to confirmed shootings, and the system missed over 200 real gunfire incidents in Manhattan in 2022. The NYPD has spent more than $45 million on the system since 2015. The comptroller advised against renewing the contract until the system can be fully evaluated.
- Company involved
- New York Police Department
- AI system involved
- ShotSpotter
10 source articles · read the reporting →
Baltimore County student handcuffed after AI gun detection system mistakes chips for firearm
A student at Kenwood High School in Essex, Maryland, was handcuffed and searched by police after an AI gun detection system misidentified his bag of Doritos as a firearm. The system, used by Baltimore County high schools, alerted law enforcement, leading officers to approach Taki Allen with guns drawn. Allen was detained and searched but no weapon was found. The school acknowledged the incident and offered counseling to affected students.
- Company involved
- Baltimore County Public Schools
3 source articles · read the reporting →
xAI's Grok Chatbot Spreads Misinformation About Bondi Beach Shooting
On 14 December 2025, xAI's Grok chatbot was found to be generating false and misleading information in response to user queries about the Bondi Beach shooting. The AI misidentified a video of a bystander disarming the shooter, claimed a photo of the injured bystander was of an Israeli hostage, and confused the event with other incidents. xAI responded to a request for comment with an automated message saying 'Legacy Media Lies,' and the glitch remained unresolved.
- Company involved
- xAI
- AI system involved
- Grok
3 source articles · read the reporting →
Baltimore County Schools Relocate Students After AI Gun False Alarm
On November 7, 2025, an AI security system called Omnilert reported a possible gun at Parkville High School in Baltimore County, Maryland. Students were relocated while police searched the school, but no threat was found. The incident follows a similar false alarm at Kenwood High School in October, where Omnilert mistook a bag of chips for a gun, leading to students being handcuffed. Baltimore County Public Schools has promised annual training on protocols for responding to Omnilert alerts.
- Company involved
- Baltimore County Public Schools
- AI system involved
- Omnilert
1 source article · read the reporting →
Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons
Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.
- Company involved
- Lockport City School District
- AI system involved
- AEGIS
1 source article · read the reporting →
Durham Police uses Experian Mosaic data in HART AI risk tool
Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.
- Company involved
- Durham Constabulary
- AI system involved
- Harm Assessment Risk Tool (HART)
9 source articles · read the reporting →
Chicago PD predictive policing program led to man being shot twice
In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.
- Company involved
- Chicago Police Department
- AI system involved
- heat list
10 source articles · read the reporting →
Police facial recognition robot identifies anger and distress
A police facial recognition robot identifies anger and distress. The article gives no further details about the system, its deployment, or any consequences.
8 source articles · read the reporting →
Alonzo Sawyer falsely arrested after face recognition misidentification by Maryland Transit Police
Alonzo Sawyer was arrested in spring 2022 after an intelligence analyst using face recognition software identified him as a possible match for a bus assault suspect. He spent nine days in jail before the actual suspect was identified by the victim. His wife Carronne Sawyer advocated for his release and later testified in support of proposed Maryland legislation to regulate police use of face recognition. The incident is one of several known false arrests of Black men due to face recognition errors.
- Company involved
- Maryland Transit Administration Police
6 source articles · read the reporting →
Israeli military uses Smash Hopper turret against Palestinian protesters
The Israeli military deployed Smash Hopper remote-controlled gun turrets in the West Bank. The turrets fire stun grenades, less-than-lethal bullets, and tear gas at Palestinian protesters without warning. The systems were observed at Al-Aroub refugee camp and Hebron in October 2022. The Smash Hopper is produced by Smart Shooter.
- Company involved
- Israeli military
- AI system involved
- Smash Hopper
10 source articles · read the reporting →
ViaQuatro's facial recognition system in São Paulo metro challenged in court
In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.
- Company involved
- ViaQuatro
- AI system involved
- Digital Interactive Doors System (DID system)
10 source articles · read the reporting →
Hamburg deployed mass surveillance for G20 Summit
The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.
- Company involved
- Senate of Hamburg
10 source articles · read the reporting →