Baltimore County student handcuffed after AI gun detection system mistakes chips for firearm
A student at Kenwood High School in Essex, Maryland, was handcuffed and searched by police after an AI gun detection system misidentified his bag of Doritos as a firearm. The system, used by Baltimore County high schools, alerted law enforcement, leading officers to approach Taki Allen with guns drawn. Allen was detained and searched but no weapon was found. The school acknowledged the incident and offered counseling to affected students.
- Company involved
- Baltimore County Public Schools
3 source articles · read the reporting →
xAI's Grok Chatbot Spreads Misinformation About Bondi Beach Shooting
On 14 December 2025, xAI's Grok chatbot was found to be generating false and misleading information in response to user queries about the Bondi Beach shooting. The AI misidentified a video of a bystander disarming the shooter, claimed a photo of the injured bystander was of an Israeli hostage, and confused the event with other incidents. xAI responded to a request for comment with an automated message saying 'Legacy Media Lies,' and the glitch remained unresolved.
- Company involved
- xAI
- AI system involved
- Grok
3 source articles · read the reporting →
Prairie Village Police Stop Lawyer at Gunpoint After License Plate Reader Error
In April 2014, lawyer Mark Molner was driving his BMW in Prairie Village, Kansas, when police stopped him because a license plate reader misread a '7' as a '2', falsely identifying his car as a stolen Oldsmobile. An officer approached with his gun drawn but not pointed at Molner, who was shocked. The police later explained the error, and Molner did not pursue legal action.
- Company involved
- Prairie Village Police Department
- AI system involved
- Elsag PMH-900
2 source articles · read the reporting →
Baltimore County Schools Relocate Students After AI Gun False Alarm
On November 7, 2025, an AI security system called Omnilert reported a possible gun at Parkville High School in Baltimore County, Maryland. Students were relocated while police searched the school, but no threat was found. The incident follows a similar false alarm at Kenwood High School in October, where Omnilert mistook a bag of chips for a gun, leading to students being handcuffed. Baltimore County Public Schools has promised annual training on protocols for responding to Omnilert alerts.
- Company involved
- Baltimore County Public Schools
- AI system involved
- Omnilert
1 source article · read the reporting →
Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons
Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.
- Company involved
- Lockport City School District
- AI system involved
- AEGIS
1 source article · read the reporting →
Met Police's Gang Violence Matrix accused of racial discrimination
The Metropolitan Police Service's Gang Violence Matrix, a database scoring individuals on gang involvement risk, has been accused by Amnesty International of being racially discriminatory and breaching human rights law. The matrix, set up after the 2011 London riots, holds data on about 3,800 people, with 78% being black. The Information Commissioner's Office is investigating the database.
- Company involved
- Metropolitan Police Service
- AI system involved
- Gang Violence Matrix
9 source articles · read the reporting →
Durham Police uses Experian Mosaic data in HART AI risk tool
Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.
- Company involved
- Durham Constabulary
- AI system involved
- Harm Assessment Risk Tool (HART)
9 source articles · read the reporting →
Chicago PD predictive policing program led to man being shot twice
In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.
- Company involved
- Chicago Police Department
- AI system involved
- heat list
10 source articles · read the reporting →
Activist challenges Met Police over false facial recognition arrest
In early 2024, Black British activist Shaun Thompson was detained by Metropolitan Police at London Bridge station after live facial recognition technology wrongly identified him as a suspect. He was held for nearly 30 minutes before being released after showing his passport. Thompson has launched a legal challenge seeking a judicial review of the technology's use, alleging it is intrusive and treats people as guilty until proven innocent. The Metropolitan Police declined to comment.
- Company involved
- Metropolitan Police
3 source articles · read the reporting →
Police facial recognition robot identifies anger and distress
A police facial recognition robot identifies anger and distress. The article gives no further details about the system, its deployment, or any consequences.
8 source articles · read the reporting →
Alonzo Sawyer falsely arrested after face recognition misidentification by Maryland Transit Police
Alonzo Sawyer was arrested in spring 2022 after an intelligence analyst using face recognition software identified him as a possible match for a bus assault suspect. He spent nine days in jail before the actual suspect was identified by the victim. His wife Carronne Sawyer advocated for his release and later testified in support of proposed Maryland legislation to regulate police use of face recognition. The incident is one of several known false arrests of Black men due to face recognition errors.
- Company involved
- Maryland Transit Administration Police
6 source articles · read the reporting →
Israeli military uses Smash Hopper turret against Palestinian protesters
The Israeli military deployed Smash Hopper remote-controlled gun turrets in the West Bank. The turrets fire stun grenades, less-than-lethal bullets, and tear gas at Palestinian protesters without warning. The systems were observed at Al-Aroub refugee camp and Hebron in October 2022. The Smash Hopper is produced by Smart Shooter.
- Company involved
- Israeli military
- AI system involved
- Smash Hopper
10 source articles · read the reporting →
ViaQuatro's facial recognition system in São Paulo metro challenged in court
In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.
- Company involved
- ViaQuatro
- AI system involved
- Digital Interactive Doors System (DID system)
10 source articles · read the reporting →
Hamburg deployed mass surveillance for G20 Summit
The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.
- Company involved
- Senate of Hamburg
10 source articles · read the reporting →
LAPD told officers to collect social media data on every civilian stopped
The Los Angeles Police Department directed officers to record the social media accounts of every civilian they interviewed, including those not arrested or accused of a crime, according to records obtained by the Brennan Center for Justice. The field interview cards, which also ask for social security numbers, have raised civil liberties concerns. Prosecutors have accused three officers of using the cards to falsely label civilians as gang members. The LAPD said the policy was being updated but did not respond to questions about its use of social media monitoring tools including Media Sonar and Geofeedia.
- Company involved
- Los Angeles Police Department (LAPD)
- AI system involved
- Field interview cards, Media Sonar, Geofeedia
10 source articles · read the reporting →
Met Police buys £3m retrospective facial recognition system
The Metropolitan Police Service (MPS) has awarded a £3 million, four-year contract to Northgate Public Services for a new retrospective facial-recognition (RFR) system to be deployed within three months. RFR processes biometric information from historic CCTV, social media, and other images to identify suspects and missing persons, operating retroactively unlike live facial recognition. The procurement was approved by the Mayor's Office for Policing and Crime in August 2021. The MPS states that human-in-the-loop decision-making will be used, but digital rights groups and a former biometrics commissioner have raised concerns about potential discrimination, overrepresentation of marginalised groups in watch lists, and lack of a legislative framework.
- Company involved
- Metropolitan Police Service
- AI system involved
- Retrospective facial-recognition software
9 source articles · read the reporting →
St. Louis police arrest man after facial recognition match without corroboration
Christopher Gatlin was arrested and jailed for an assault on a security guard after police used facial recognition software to identify him from a blurry surveillance image. The lead detective built a case against Gatlin despite the city's policy that AI results are nonscientific and should not be the sole basis for a decision. A witness was steered by officers to select Gatlin from a photo lineup, and the case was later dismissed after more than two years. Gatlin alleges wrongful arrest and has filed a lawsuit.
- Company involved
- St. Louis County Police Department
- AI system involved
- Unnamed facial recognition program
4 source articles · read the reporting →
OpenAI cuts off engineer who created ChatGPT-powered robotic sentry rifle
An engineer known as STS 3D created a robotic sentry rifle that uses OpenAI's Realtime API to aim and fire a rifle in response to voice commands. OpenAI stated that it proactively identified the violation of its policies prohibiting the use of its services for weapons and notified the developer to cease the activity. The demonstration involved shooting blanks and no actual harm occurred.
- AI system involved
- ChatGPT-powered robotic sentry rifle
4 source articles · read the reporting →
Meta's automated system mistakenly removes Al-Shifa hospital video
Meta's automated content moderation system removed an Instagram video showing the aftermath of a strike on Al-Shifa hospital in Gaza, citing its Violent and Graphic Content policy. The user appealed to the Oversight Board, which found that the removal was incorrect. Meta subsequently restored the content with a warning screen.
- Company involved
- Meta
- AI system involved
- Graphic and Violent Content classifier
10 source articles · read the reporting →
Houston's ShotSpotter system delays police response and over-polices minority communities
Houston Police Department deployed ShotSpotter, a gunshot detection system, in Southeast and Northwest Houston starting in late 2020. The system alerts police to suspected gunfire, but over 80% of alerts are unfounded. This has led to longer response times for other calls and increased police presence in predominantly Black and brown neighborhoods, causing anxiety and concerns of over-policing. Critics argue the technology has not reduced gun violence and diverts resources from more effective strategies.
- Company involved
- Houston Police Department
- AI system involved
- ShotSpotter
7 source articles · read the reporting →
Facial recognition system falsely detains woman in Copacabana, Rio de Janeiro
A facial recognition system deployed by the Military Police of Rio de Janeiro in Copacabana falsely identified a local resident as a wanted fugitive. The system flagged the woman with a 70% probability match, leading police to detain her for over an hour before realising the error. The police spokesperson acknowledged the system's statistical error rate and stated that officers attempt to verify identities on site. The incident is one of several false positives reported with the system.
- Company involved
- Polícia Militar do Rio de Janeiro
10 source articles · read the reporting →
Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments
ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.
- Company involved
- City of Chicago
- AI system involved
- ShotSpotter
7 source articles · read the reporting →
Cruise robotaxi appears to hinder emergency crews after San Francisco mass shooting
A Cruise autonomous vehicle appeared to block emergency crews responding to a mass shooting in San Francisco's Mission District on 9 June 2023. A police officer in video footage says the robotaxi was blocking emergency medical and fire vehicles. Cruise denied obstructing access and said an employee moved the vehicle within half an hour. San Francisco police said they were investigating.
- Company involved
- Cruise
10 source articles · read the reporting →
Sri Lankan government falsely identified Amara Majeed as Easter bombing suspect due to facial recognition error
Amara Majeed testified to the Maryland General Assembly that Sri Lankan authorities falsely identified her as a suspect in the 2019 Easter bombings after an error in facial recognition technology. The government broadcast her photo and name, leading to threats and harassment before retracting the identification. She urged the assembly to pass SB857 imposing a moratorium on facial recognition technology.
- Company involved
- Sri Lankan government
4 source articles · read the reporting →
