Brainwash cafe customers unknowingly put in AI surveillance dataset
In 2014, customers at the Brainwash Cafe in San Francisco were recorded by a publicly available webcam. The images were compiled into a dataset containing 11,917 photos for training surveillance-related object and head detection algorithms. The dataset was later removed from access following an investigation revealing use by researchers affiliated with the National University of Defense Technology in China. The dataset's creators are accused of collecting the images without the cafe customers' knowledge or consent.
- Company involved
- Stanford University
- AI system involved
- Brainwash dataset
1 source article · read the reporting →
Dahua Exposed for Uyghur Tracking Software in Surveillance Systems
Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.
- Company involved
- Dahua Technology
- AI system involved
- Dahua SDK
1 source article · read the reporting →
Apple sued for $1 billion after facial recognition allegedly misidentifies teen as thief
Ousmane Bah, an 18-year-old student, alleges that Apple and its security firm used facial recognition software to incorrectly identify him as a shoplifter in multiple Apple Store thefts. He was arrested at his home and missed school, causing emotional distress and academic harm. While charges in New York and Boston were dropped after a detective noted Bah looked nothing like the suspect, a case in New Jersey remains pending. Apple denies using facial recognition in its stores, but the lawsuit claims the technology was used by its security contractor.
- Company involved
- Apple
5 source articles · read the reporting →
Fake journalist network used AI avatars to place pro-UAE propaganda
A network of at least 19 fake personas used AI-generated or stolen avatars to place nearly 100 opinion articles in almost 50 publications, including the Jerusalem Post and Al Arabiya. The articles lauded the United Arab Emirates and advocated for a tough line against Qatar, Turkey, and Iran. The operation was exposed by The Daily Beast, and Twitter subsequently suspended 16 accounts for platform manipulation. The incident involved the use of AI to create fake journalist profiles to disseminate propaganda.
- Company involved
- The Arab Eye
1 source article · read the reporting →
Father Finds Murdered Daughter Impersonated by Character.ai Chatbot
Drew Crecente discovered that a chatbot on Character.ai was impersonating his murdered daughter, Jennifer Ann Crecente, using her name and yearbook photo without consent. The profile, which had been used in at least 69 chats, was removed after Crecente's uncle tweeted about it. Character.ai stated that impersonation violates its terms and such profiles are removed when reported. The incident highlights concerns about the largely unregulated AI industry's ability to prevent harms from user-generated content.
- Company involved
- Character.ai
- AI system involved
- Character.ai
9 source articles · read the reporting →
France uses AI to monitor mask-wearing on public transport
France has deployed AI software from startup DatakaLab in the Paris metro to check if passengers are wearing face masks. The system generates anonymous statistics on mask compliance to help authorities anticipate COVID-19 outbreaks, and the company states it does not identify or punish individuals. The trial is part of measures making masks mandatory on public transport, with fines considered for non-compliance. Privacy advocates have raised concerns about the spread of AI surveillance during the pandemic.
1 source article · read the reporting →
Las Vegas police used unsuitable facial recognition images in nearly half of searches
The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.
- Company involved
- Las Vegas Metropolitan Police Department
- AI system involved
- Vigilant Solutions facial recognition system
1 source article · read the reporting →
Deepfake video of ITV journalist Mary Nightingale promotes investment scam
In February 2024, a deepfake video of ITV News presenter Mary Nightingale appeared on social media. The manipulated 45-second clip showed Nightingale apparently presenting the ITV Evening News before promoting a fraudulent investment app. The video was deleted shortly after it was posted. Nightingale said she was "livid" and described the incident as identity theft.
6 source articles · read the reporting →
NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram
The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.
- Company involved
- NYPD
- AI system involved
- Facial Identification Section
3 source articles · read the reporting →
Delhi Government uses facial recognition on children in government schools
The Delhi Government's Education Department is using facial recognition technology in conjunction with CCTV cameras in government schools, according to responses to RTI requests filed by the Internet Freedom Foundation. The organisation urged the Delhi Commission for Protection of Child Rights to intervene, alleging that the practice violates children's right to privacy and education under the Indian Constitution. No specific incident of harm has been reported, but the organisation warns of potential misidentification and disproportionate penalties.
- Company involved
- Government of NCT of Delhi, Education Department
10 source articles · read the reporting →
Macy's and Sunglass Hut facial recognition misidentifies man, leading to wrongful jailing
Harvey Eugene Murphy Jr was misidentified by facial recognition software used by Sunglass Hut and Macy's as the perpetrator of an armed robbery. He was arrested and jailed, where he alleges he was beaten and raped. His alibi was later confirmed and charges were dropped. He is suing the companies for $10 million in damages.
- Company involved
- Macy's and EssilorLuxottica
3 source articles · read the reporting →
Docomo Pacific CEO's mother targeted in AI voice cloning scam
Docomo Pacific's CEO Christine Baleto revealed that her elderly mother received a scam call from someone impersonating a federal agent, using AI voice cloning to pressure her into revealing personal information. The caller threatened to send agents to her home if she did not comply. Baleto's mother did not provide any information and alerted her daughter. Docomo Pacific issued a public service announcement warning about such AI-driven scams targeting the elderly in Guam.
2 source articles · read the reporting →
Bronx Man Jailed Six Months After Facial Recognition Misidentification
In April 2018, a Bronx man was arrested for stealing socks from a TJ Maxx after police used facial recognition to identify him from security footage. He maintained he was at a hospital for his child's birth. A prosecutor disclosed the use of facial recognition, and a judge ordered a hearing on the identification process. The man accepted a plea deal for time served after spending six months in jail, avoiding a trial.
- Company involved
- New York Police Department
2 source articles · read the reporting →
Miami Police Used Clearview AI to Identify Protester
NBC 6 Investigators revealed that Miami Police used the facial recognition program Clearview AI to identify Oriana Albornoz, a 25-year-old woman, as the person accused of throwing rocks at officers during a protest on May 30, 2020. She was arrested a month later and charged with battery on a police officer; her attorney said he was unaware police had used the technology, as it was not disclosed in the arrest report. The police department acknowledged using Clearview AI to identify violent protest suspects after the fact, but stated they do not surveil peaceful protesters. The case is ongoing, with Albornoz pleading not guilty.
- Company involved
- Miami Police Department
- AI system involved
- Clearview AI
4 source articles · read the reporting →
Ring's AI pet-search feature draws privacy backlash after Super Bowl ad
Ring, an Amazon company, promoted its Search Party feature in a Super Bowl advertisement, saying its AI helps reunite dog owners with missing pets. Critics said the feature, which is enabled by default, turns Ring doorbells into a mass surveillance network and could easily be adapted to track people. Ring said it had reunited 99 dogs in the US in 90 days and that customers keep full control of their data.
- Company involved
- Ring
- AI system involved
- Search Party
5 source articles · read the reporting →
Sainsbury's ejects man misidentified by facial recognition software
Warren Rajah was told to leave a Sainsbury's supermarket in Elephant and Castle, London, after staff incorrectly identified him as an offender flagged by Facewatch facial recognition software. The error occurred at the human verification stage, not the technology itself. Sainsbury's apologised and offered a £75 shopping voucher, and Facewatch confirmed Rajah was not on its database. Rajah criticised the lack of explanation and recourse, and expressed concern for vulnerable customers.
- Company involved
- Sainsbury's
- AI system involved
- Facewatch
5 source articles · read the reporting →
Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired
Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.
- Company involved
- Pankaj
- AI system involved
- AI roommate
5 source articles · read the reporting →
Hackers Extract Encryption Keys from Flock Surveillance Cameras, Revealing Person Detection Alongside Vehicle Tracking - finance.biggo.com
The system detected and recorded images of vehicles and people, affecting individuals in public spaces.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety ALPR cameras
1 source article · read the reporting →
AI Facial Recognition Didn't Put This Tennessee Grandma in Jail for 6 Months. Bad Policing Did. - Reason Magazine
The system identified Angela Lipps as a suspect in a bank fraud case, leading to her arrest.
- Company involved
- Fargo Police Department
- AI system involved
- Clearview AI
1 source article · read the reporting →
Fort Myers man falsely arrested; lawsuit says AI program is to blame - WINK News
Police falsely arrested an innocent man due to a facial recognition misidentification
- Company involved
- Jacksonville Beach Police Department
- AI system involved
- FACESNXT
1 source article · read the reporting →
Lawsuit claims facial recognition program led to wrongful arrest - FOX 2
Identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17 months in jail.
- Company involved
- St. Louis County Police Department
- AI system involved
- Rekognition
1 source article · read the reporting →
AI-NOMIS data breach exposes thousands of AI-generated deepfake images
Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.
- Company involved
- AI-NOMIS
- AI system involved
- GenNomis
5 source articles · read the reporting →
Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.
Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.
- Company involved
- Sports Direct
- AI system involved
- Facewatch
2 source articles · read the reporting →
Brazilian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that LAION-5B, a dataset used to train AI tools, contains identifiable photos of Brazilian children scraped from the web without their knowledge or consent. The dataset includes names and locations of children. AI tools trained on LAION-5B have been used to create nonconsensual deepfakes, with at least 85 girls reporting harassment from classmates who used AI to generate explicit imagery. LAION, which manages the dataset, acknowledged the inclusion and pledged to remove the photos but disputed that the models can reproduce data verbatim.
- Company involved
- LAION
- AI system involved
- LAION-5B
7 source articles · read the reporting →
