The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

236 incidents closest to “BriefCam Ltd. (now integrated into Milestone Systems A/S, Canon Group)” · matched on meaning · public reporting

WF-ADQZLS8 Oct 2023

IDF Used AI System Lavender to Target Tens of Thousands in Gaza

The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.

Company involved
Israel Defense Forces
AI system involved
Lavender

9 source articles · read the reporting →

WF-HF1YRW1 Sep 2023

Xuhui police expand facial recognition surveillance to profile 1.1 million residents

The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.

Company involved
Shanghai Municipal Bureau of Public Security, Xuhui District Branch
AI system involved
Intelligent Image Recognition System

3 source articles · read the reporting →

Users jailbreak Luma Labs Dream Machine to generate porn

Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.

Company involved
Luma Labs
AI system involved
Dream Machine

3 source articles · read the reporting →

WF-UKLVHR27 Oct 2014

Brainwash cafe customers unknowingly put in AI surveillance dataset

In 2014, customers at the Brainwash Cafe in San Francisco were recorded by a publicly available webcam. The images were compiled into a dataset containing 11,917 photos for training surveillance-related object and head detection algorithms. The dataset was later removed from access following an investigation revealing use by researchers affiliated with the National University of Defense Technology in China. The dataset's creators are accused of collecting the images without the cafe customers' knowledge or consent.

Company involved
Stanford University
AI system involved
Brainwash dataset

1 source article · read the reporting →

WF-1MQMSR21 Apr 2020

Dahua Exposed for Uyghur Tracking Software in Surveillance Systems

Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.

Company involved
Dahua Technology
AI system involved
Dahua SDK

1 source article · read the reporting →

WF-KH4UOW1 Aug 2020

Google Cloud Used in CBP AI Virtual Border Wall Contract

The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.

Company involved
U.S. Customs and Border Protection (CBP)
AI system involved
Google Cloud AI Platform with Anduril Lattice and Sentry Towers

1 source article · read the reporting →

WF-EOQHEX1 Mar 2023

Adobe Stock creators say Firefly trained on their images without consent

Adobe Stock contributors allege that Adobe trained its Firefly generative AI model on their stock images without express notification or consent. They say Firefly's popularity is reducing demand for their stock photos and flooding the platform with AI-generated images. Adobe says Firefly is still in beta and it is committed to compensating creators, with details to come when generally available.

Company involved
Adobe
AI system involved
Adobe Firefly

1 source article · read the reporting →

WF-ZW37ZY31 Oct 2023

Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians

In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.

Company involved
Israel Defense Forces

3 source articles · read the reporting →

WF-BN49TF7 Aug 2020

NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram

The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.

Company involved
NYPD
AI system involved
Facial Identification Section

3 source articles · read the reporting →

WF-WNQZLI1 Jan 2020

Clearview AI settles with ACLU over facial recognition database sales

Clearview AI has agreed to stop selling its facial recognition database to most private US companies as part of a proposed settlement with the ACLU. The company scraped billions of images from social media without consent to build its database, violating Illinois' Biometric Information Privacy Act. The settlement requires Clearview to delete old facial vectors and allow Illinois residents to opt out. The company can still sell its technology to law enforcement and government agencies.

Company involved
Clearview AI
AI system involved
Clearview AI facial recognition database

8 source articles · read the reporting →

Delhi Government uses facial recognition on children in government schools

The Delhi Government's Education Department is using facial recognition technology in conjunction with CCTV cameras in government schools, according to responses to RTI requests filed by the Internet Freedom Foundation. The organisation urged the Delhi Commission for Protection of Child Rights to intervene, alleging that the practice violates children's right to privacy and education under the Indian Constitution. No specific incident of harm has been reported, but the organisation warns of potential misidentification and disproportionate penalties.

Company involved
Government of NCT of Delhi, Education Department

10 source articles · read the reporting →

WF-74CS0825 Nov 2025

Thailand halts iris-scan crypto scheme and deletes 1.2m biometric records

The Ministry of Digital Economy and Society (DES) and the Personal Data Protection Committee (PDPC) ordered a company to stop collecting iris data and delete 1.2 million citizen records. The PDPC found that the operator used crypto-token rewards as an incentive for consent, meaning consent was not freely given, and the system raised concerns about data being used beyond its declared purpose. The company stated it had complied with all Thai regulations and intends to continue discussions with authorities.

Company involved
The company behind the iris-scan system (not named)
AI system involved
Iris-scan system

4 source articles · read the reporting →

WF-GZDT761 Jul 2024

Former Police Officer Sentenced to 5 Years After Misusing Flock Cameras To Stalk Ex-Girlfriend - Texas Scorecard

Former officer used Flock cameras to surveil and stalk his ex-girlfriend, her family members, and other romantic interests.

Company involved
Flock Safety

1 source article · read the reporting →

Hackers Extract Encryption Keys from Flock Surveillance Cameras, Revealing Person Detection Alongside Vehicle Tracking - finance.biggo.com

The system detected and recorded images of vehicles and people, affecting individuals in public spaces.

Company involved
Flock Safety
AI system involved
Flock Safety ALPR cameras

1 source article · read the reporting →

WF-TF37IC13 Nov 2025

Flock seeks to have security researchers' map of Flock cameras taken down — unauthenticated flaw exposed 335,701 camera locations nationwide…

The system captured license plate data and vehicle locations of individuals passing the cameras.

Company involved
Flock Safety
AI system involved
Flock Safety cameras

1 source article · read the reporting →

Oakland County investigating alleged misuse of Flock camera data by former deputy - WXYZ 7 News Detroit

The Flock camera system collected and stored license plate data, and a former deputy allegedly accessed it without authorization.

Company involved
Oakland County Sheriff's Office
AI system involved
Flock camera

1 source article · read the reporting →

New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com

The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.

Company involved
Meta Platforms
AI system involved
Meta AI-enabled Ray-Ban and Oakley smart glasses

1 source article · read the reporting →

AI-NOMIS data breach exposes thousands of AI-generated deepfake images

Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.

Company involved
AI-NOMIS
AI system involved
GenNomis

5 source articles · read the reporting →

Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.

Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.

Company involved
Sports Direct
AI system involved
Facewatch

2 source articles · read the reporting →

WF-V0IBRA20 Feb 2024

Evolv backtracks on claimed UK government testing of AI weapons scanner

Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.

Company involved
Evolv Technology
AI system involved
Evolv Express

3 source articles · read the reporting →

WF-N2X8EZ1 Jun 2024

Australian children's photos scraped into LAION-5B AI dataset without consent

Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.

Company involved
LAION
AI system involved
LAION-5B

4 source articles · read the reporting →

WF-8RC0AT1 Oct 2025

Kingsville police officer resigns after investigation into alleged Flock camera misuse - Yahoo

Kingsville police officer resigns after investigation into alleged Flock camera misuse Yahoo

Company involved
Kingsville Police Department
AI system involved
Flock camera system

1 source article · read the reporting →

WF-7B0GBP1 Aug 2026

More than 70 sue Meta in California, alleging smart glasses exposed intimate footage - The Cool Down

The smart glasses recorded and transmitted intimate images and videos of wearers and bystanders to Meta for AI training without consent.

Company involved
Meta
AI system involved
Ray-Ban Meta smart glasses

1 source article · read the reporting →

WF-QGL9US27 May 2026

Boulder police chief faces class action over Flock cameras' warrantless surveillance - Courthouse News

The system captured and stored license plate data and vehicle movements of Boulder residents and commuters, making it searchable by law enforcement without a warrant.

Company involved
Boulder Police Department
AI system involved
Flock Safety

1 source article · read the reporting →

← Newerpage 9 of 10Older →