The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

188 incidents closest to “FACE Plus” · matched on meaning · public reporting

WF-O2M7OU21 Mar 2025

City analyst Michael Hewson cloned in AI deepfake scam on social media

A deepfake video using AI to impersonate City analyst Michael Hewson circulated on Facebook and Instagram, directing users to a WhatsApp group promising undervalued investments. The scam used fear-of-missing-out tactics to lure victims. Hewson publicly disavowed the video and reported it to Meta, expressing anger.

Company involved
Meta

4 source articles · read the reporting →

PimEyes facial recognition used to unmask porn actors and Facebook friends

A man used the facial recognition site PimEyes to identify porn actors and women from his Facebook friends by uploading their photos and finding matching images online. The system had no controls to prevent searching for others without consent. The article alleges that this invasion of privacy could lead to discrimination and harassment, and that PimEyes offered a paid service to remove photos but did not prevent the searches.

Company involved
PimEyes
AI system involved
PimEyes

3 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-ROMQCH5 Feb 2024

OnlyFake site uses neural networks to generate fake IDs, bypasses OKX verification

An underground website called OnlyFake uses neural networks to generate realistic photos of fake IDs for $15. The journalist tested the service and obtained a convincing California driver's license. They then used another fake ID to successfully bypass the identity verification process on OKX, a cryptocurrency exchange. The article alleges that this technology could streamline bank fraud and money laundering, but reports no actual financial loss.

Company involved
OKX
AI system involved
OnlyFake

10 source articles · read the reporting →

Hong Kong police arrest eight over deepfake bank account scam

Hong Kong police arrested eight people accused of running a scam ring that used deepfake images to bypass bank verification checks and open accounts. The deepfakes were created by merging scammers' faces with those on lost identity cards using artificial intelligence. The arrests were announced on 19 April 2025.

2 source articles · read the reporting →

MakeApp makeup removal app adds imperfections, causing controversy

MakeApp, an AI-powered app that digitally removes makeup from photos, has caused controversy by adding imperfections such as redness and dullness to users' faces. Users complained on Twitter that the app exacerbates insecurities and low self-esteem. The founder defended the app as an experiment, denying any intent to shame women.

Company involved
MakeApp
AI system involved
MakeApp

10 source articles · read the reporting →

WF-YNC84Z9 Jul 2019

Facial recognition system falsely detains woman in Copacabana, Rio de Janeiro

A facial recognition system deployed by the Military Police of Rio de Janeiro in Copacabana falsely identified a local resident as a wanted fugitive. The system flagged the woman with a 70% probability match, leading police to detain her for over an hour before realising the error. The police spokesperson acknowledged the system's statistical error rate and stated that officers attempt to verify identities on site. The incident is one of several false positives reported with the system.

Company involved
Polícia Militar do Rio de Janeiro

10 source articles · read the reporting →

WF-KBL3YD15 Oct 2019

Hive Box Facial-Recognition Lockers Hacked by Children Using Photos

Fourth-grade students in Jiaxing, China, demonstrated that Hive Box's facial-recognition smart lockers could be opened with a printed photo. The company, which operates a large network of delivery lockers, acknowledged the flaw and suspended the beta feature. The incident raised concerns about the security of facial recognition technology.

Company involved
Hive Box

1 source article · read the reporting →

WF-ZJEMQ525 Apr 2024

Huawei Pura 70 series AI editing tool removes clothing unintentionally

Huawei's Pura 70 series includes an AI retouching feature that can inadvertently remove clothing from images. Users on Weibo posted videos demonstrating this, raising privacy concerns. Huawei customer service acknowledged the issue, attributing it to algorithm loopholes, and promised a fix in upcoming system updates.

Company involved
Huawei
AI system involved
Pura 70 series AI retouching feature

5 source articles · read the reporting →

WF-03V5V41 Jan 2021

PimEyes faces fine proceedings over biometric facial recognition in Baden-Württemberg

PimEyes, a facial recognition search engine, is accused of scraping images from the internet and processing biometric data without a valid legal basis under the GDPR. The data protection authority of Baden-Württemberg (LfDI) opened fine proceedings after it found PimEyes's response to its questions inadequate. PimEyes argues that the images it processes are publicly available and not personal data. The LfDI says the processing endangers citizens' rights and freedoms and is not covered by the GDPR exceptions.

Company involved
PimEyes
AI system involved
PimEyes

9 source articles · read the reporting →

WF-DLNNBB1 Jan 2015

French police secretly used Briefcam facial recognition since 2015

The French National Police has been using Briefcam's Video Synopsis software since 2015, according to internal documents obtained by Disclose. The software, which includes facial recognition capabilities, was deployed without the required data protection impact assessment or notification to the CNIL. The Ministry of the Interior concealed the use of this tool for eight years. The police hierarchy allegedly used the software for facial recognition without judicial requisition, and the DGPN did not respond to requests for comment.

Company involved
French National Police
AI system involved
Briefcam Video Synopsis

10 source articles · read the reporting →

WF-8UTONQ22 Dec 2019

Delhi Police use facial recognition to screen PM Modi rally attendees

Delhi Police used an Automated Facial Recognition System (AFRS) to screen crowds at Prime Minister Narendra Modi's rally on December 22, 2019. The system, originally installed to find missing children, was used to identify possible disruptions. Privacy advocates called the move illegal and unconstitutional, saying it amounts to mass surveillance. Police defended the use, citing credible intelligence about possible disruptions.

Company involved
Delhi Police
AI system involved
Automated Facial Recognition System (AFRS)

6 source articles · read the reporting →

WF-D4UJRR1 Sep 2024

Oversight Board considers AI-manipulated Ronaldo video promoting gambling

In September 2024, a user posted an AI-manipulated video that appeared to show Brazilian footballer Ronaldo Nazário endorsing the Plinco app, but the link led to a different game. The video was viewed about 600,000 times. A user reported it to Meta as fraud, but Meta initially left it up. After the Oversight Board selected the case, Meta acknowledged the error and removed the post for violating its fraud and spam policies.

Company involved
Meta

2 source articles · read the reporting →

WF-0MLTX024 Jul 2021

Developer iperov releases DeepFaceLive real-time face-swap AI on GitHub

The developer iperov has published DeepFaceLive, a neural network for real-time face swapping, on GitHub. The tool automatically replaces a user's face in live streams and video calls with a nonexistent model or a celebrity, and the installation instructions are simple. The developer claims 95% of deepfakes on YouTube were made with the related DeepFaceLab. No specific harm is reported, but the article highlights the tool's potential for misuse.

Company involved
iperov
AI system involved
DeepFaceLive

7 source articles · read the reporting →

WF-3NRNF21 Oct 2023

Meta's AI sticker tool generates lewd, rude, and nude images

Meta's new AI-generated sticker feature on Facebook Messenger allowed users to create inappropriate images, including child soldiers, nude politicians, and sexualised characters. The tool, powered by Meta's Llama 2 model, was found to have insufficient content filters, enabling users to bypass restrictions with typos. Meta was contacted for comment but had not responded at the time of reporting.

Company involved
Meta
AI system involved
AI-generated sticker tool

1 source article · read the reporting →

PimEyes facial recognition search engine identifies individuals from public photos

PimEyes, a Polish facial recognition search engine, allows users to upload a photo and find matching images from across the internet. The system scrapes billions of photos and creates biometric profiles without consent. A banker named Dylan (pseudonym) discovered that an old party photo of him was found by the system, potentially outing his private life. Privacy advocates and platforms like Instagram and YouTube are taking action against PimEyes, alleging violations of the GDPR.

Company involved
PimEyes
AI system involved
PimEyes

6 source articles · read the reporting →

WF-DV2LKP1 Nov 2024

Deepfake adverts using Barbara O'Neill's likeness promote fake prostate cures

AI-generated deepfake videos impersonating Australian naturopath Barbara O'Neill are circulating on Facebook, falsely endorsing a cure for prostate problems and erectile dysfunction. The videos, which have millions of views, are part of a scam to sell products or phish for personal information. Africa Check found the videos to be deepfakes, with audio out of sync and posted by accounts unaffiliated with O'Neill, who has previously warned about such impersonations.

2 source articles · read the reporting →

Tencent launches Zero-Point Cruise facial recognition to enforce night-time game curfew

Tencent has introduced a feature called Zero-Point Cruise in its games, which subjects accounts registered as adults that play at night beyond a set time to facial recognition. Anyone who refuses or fails the verification is treated as a minor and logged out. Tencent says this is intended to stop children using adult identities to evade the game curfew, and that adults who mistakenly refuse can wait for the next authentication.

Company involved
Tencent
AI system involved
零点巡航 (Zero-Point Cruise)

10 source articles · read the reporting →

WF-EUQN3V1 Jun 2015

Facebook's 'People You May Know' feature reveals psychiatrist's patients to each other

A psychiatrist discovered that Facebook's 'People You May Know' feature was recommending her patients as friends to each other and to her, despite no apparent connection. One patient saw friend suggestions for older and infirm people he did not know, who were later recognized as the psychiatrist's patients. Another patient saw a fellow patient from the office elevator, revealing their full name and profile. Facebook could not explain the specific cause but suggested phone contact syncing may have been responsible.

Company involved
Facebook
AI system involved
People You May Know

2 source articles · read the reporting →

Man uses AI face-swap to steal 15,996 yuan from financial accounts, sentenced to 4.5 years

A man in Jiangsu, China, illegally purchased 1.95 million personal records and used AI face-swapping software to bypass facial recognition on financial platforms. He accessed 23 victims' accounts, changed five passwords, and used one account to buy two phones worth 15,996 yuan. He was convicted of infringing citizens' personal information and credit card fraud, sentenced to four years and six months in prison, and ordered to pay damages and delete the data.

3 source articles · read the reporting →

Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal

Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.

Company involved
Secretaria de Segurança Pública da Bahia

2 source articles · read the reporting →

WF-7JFKYB8 May 2025

Deepfake video of CBS anchor and suspect in Frisco stabbing spreads online

An AI-generated deepfake video manipulated a CBS News Texas anchor's image and created a fake video of the suspect in a Frisco high school stabbing. The video was posted on Instagram and reposted on multiple accounts before being taken down. The incident highlights the growing ease of creating convincing deepfakes and the spread of misinformation online.

1 source article · read the reporting →

WF-30XEUN1 Jul 2019

Google contractors targeted homeless people for Pixel 4 facial recognition data

Google hired Randstad to collect facial data to train the Pixel 4's face recognition system. Contractors allegedly targeted homeless people and unaware students, using deceptive tactics such as calling it a "selfie game" and offering $5 without informing subjects they were being recorded. Google suspended the research program and opened an investigation following the report.

Company involved
Google
AI system involved
Pixel 4 facial recognition

1 source article · read the reporting →

Clearview AI facial recognition app scrapes billions of images and is used by police

Clearview AI, a secretive start-up, built a facial recognition app that matches photos to a database of more than three billion images scraped from social media and websites. More than 600 law enforcement agencies, including the FBI and Department of Homeland Security, have used the tool to identify suspects in crimes such as shoplifting, identity theft and murder. The company monitored officers who ran a reporter's photo through the app, and its founder acknowledged designing an augmented-reality prototype but said there were no plans to release it. Critics warned the tool could end anonymity and enable misuse.

Company involved
Clearview AI
AI system involved
Clearview AI facial recognition app

2 source articles · read the reporting →

← Newerpage 7 of 8Older →