The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “IDEMIA Public Security (IDEMIA Group)” · matched on meaning · public reporting

WF-YGF8YN1 Nov 2019

Beijing Subway to use facial recognition for passenger screening

The Beijing Subway plans to introduce security screenings that use an AI-powered camera system to divide passengers into groups based on facial recognition. The system is intended to single out people for different security measures, aiming to speed up subway traffic. The article does not report any specific incident of harm or complaint.

Company involved
Beijing Subway
AI system involved
AI-powered camera system

10 source articles · read the reporting →

WF-C9VJNA1 Dec 2018

CNIL says facial recognition trial in French high schools is illegal

The French data protection authority (CNIL) issued a non-binding opinion that a planned trial of facial recognition at two high schools in Nice and Marseille is illegal under the GDPR. The trial, approved by the South Region in December 2018, involved biometric portals to identify students. Digital rights groups, parents and teachers' unions opposed the experiment and filed a lawsuit. The CNIL stated that the system was too intrusive and that less intrusive methods could achieve the same purpose.

Company involved
South Region (Région Sud)
AI system involved
Cisco facial recognition system

10 source articles · read the reporting →

WF-FRRPXY1 Dec 2019

Kneron researchers bypass facial recognition at airport and train station using mask and photo

In December 2019, Kneron researchers tested facial recognition systems at a high-speed rail station in China, Schiphol Airport, point-of-sale terminals, and a mobile phone. Using a high-quality 3D mask and a photo on a phone screen, they successfully deceived the systems, gaining access and making purchases. The survey highlighted security shortfalls in many commercial facial recognition solutions.

Company involved
Schiphol Airport; high-speed rail station in China

10 source articles · read the reporting →

WF-DCT0851 Sep 2019

Swedish police fined for unlawful use of Clearview AI facial recognition

Sweden's data protection authority IMY fined the Swedish Police Authority €250,000 for unlawfully using Clearview AI's facial-recognition app. The police used the app between autumn 2019 and March 2020 without authorisation or a required data protection impact assessment. The IMY ordered the police to ensure Clearview AI deletes the data and to train employees to avoid future breaches.

Company involved
Swedish Police Authority
AI system involved
Clearview AI

3 source articles · read the reporting →

WF-6SGCA11 Jun 2020

OAIC finds 7-Eleven breached privacy with facial recognition surveys

The Australian Information Commissioner found that 7-Eleven interfered with customers' privacy by collecting facial images and creating faceprints through in-store surveys without adequate notice or consent. The system was used to exclude non-genuine responses and profile demographics. The OAIC ordered 7-Eleven to destroy the collected data and cease the practice.

Company involved
7-Eleven

9 source articles · read the reporting →

WF-GIG3RP26 Feb 2020

Italian regulator orders Como to stop facial recognition surveillance

The Italian Data Protection Authority (Garante) ordered the Municipality of Como to cease its use of a facial recognition system installed in Parco Tokamakhi near the main railway station. The system was intended to identify people under investigation or reported missing, and to detect suspicious behaviour. The Garante found that the municipality lacked a specific legal basis under national law for collecting and storing biometric data, and issued an injunction to conform to the law.

Company involved
Comune di Como
AI system involved
facial recognition system

9 source articles · read the reporting →

WF-60D14K1 Nov 2018

EU to trial AI lie detector at airports in Hungary, Latvia, Greece

The European Union is set to trial an AI-powered lie detector system called iBorderCtrl at airports in Hungary, Latvia and Greece. The system uses a virtual avatar to question passengers and monitors their facial expressions to detect deception. Privacy groups have raised concerns about bias and error rates, noting that the technology has only been tested on 32 people. The trial will require passenger consent and will be overseen by human guards.

Company involved
European Union (iBorderCtrl project)
AI system involved
iBorderCtrl

6 source articles · read the reporting →

WF-2LPYR714 Dec 2020

Myanmar junta deploys Huawei facial recognition system threatening rights

In December 2020, the Myanmar military junta rolled out the first phase of its Safe City initiative in Naypyidaw, using 335 surveillance cameras from Huawei equipped with facial recognition and license plate recognition technology. The system automatically scans faces and plates and alerts authorities to individuals on a wanted list. Human Rights Watch warns that the system poses a grave risk to privacy and rights, especially for anti-coup activists, and that the junta has suspended key privacy protections.

Company involved
Myanmar military junta
AI system involved
Safe City surveillance system

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

WF-ASJEKJ1 Jan 2021

GSMA fined €200,000 for facial recognition privacy violation at MWC

In 2021, Dr Anastasia Dedyukhina was invited to speak at Mobile World Congress in Barcelona. The organizers required her to upload biometric data (passport) online for identity verification, which she refused. She was then forced to attend virtually. She filed a complaint with the Spanish data protection agency (AEPD) along with Adam Leon Smith. Two years later, the AEPD fined GSMA €200,000 for infringing the privacy of nearly 20,000 attendees through the use of facial recognition without proper justification.

Company involved
GSMA

10 source articles · read the reporting →

WF-YO0AUI1 Jan 2019

Clearview AI to pull out of Canada and stop working with RCMP amid privacy investigation

Clearview AI, the US facial recognition company, has agreed to stop offering its services in Canada amid a joint investigation by Canadian privacy regulators. The company's technology, which matches images against billions of photos scraped from the internet, was used by the RCMP and more than 20 other police services across Canada. The Office of the Privacy Commissioner of Canada announced the 'indefinite suspension' of Clearview's contract with the RCMP, its last remaining Canadian client. The investigation into whether the technology breaches Canadian privacy laws will continue.

Company involved
Clearview AI
AI system involved
Clearview AI

10 source articles · read the reporting →

WF-IK4RSL1 Jul 2016

CBSA tested facial recognition on millions at Toronto Pearson Airport in 2016

In 2016, the Canada Border Services Agency (CBSA) secretly tested facial recognition technology on millions of travellers at Toronto Pearson Airport without their knowledge. The system, supplied by Face4 Systems, matched faces against a database of previously deported individuals. The CBSA stated that no one was deported as a result of the pilot, and the technology was removed after six months. Privacy advocates raised concerns about lack of consent, transparency, and potential racial bias.

Company involved
Canada Border Services Agency
AI system involved
Faces on the Move

8 source articles · read the reporting →

WF-CQ2Y4G1 Jan 2019

Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade

In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.

Company involved
Ministry of Interior
AI system involved
Huawei smart surveillance cameras

10 source articles · read the reporting →

EPIC lawsuit challenges USPS secret surveillance program using facial recognition

The United States Postal Service's law enforcement wing, the Postal Inspection Service, ran a secret surveillance program called the Internet Covert Operations Program (iCOP) that used facial recognition from Clearview AI and social media monitoring tools to infiltrate online communities and monitor protests. The Electronic Privacy Information Center (EPIC) sued the USPS for failing to conduct and publish a privacy impact assessment as required by the E-Government Act. A federal district court dismissed the lawsuit on standing grounds, ruling that EPIC did not suffer a cognizable injury from the agency's refusal to disclose information about the program.

Company involved
United States Postal Service
AI system involved
Internet Covert Operations Program (iCOP)

10 source articles · read the reporting →

WF-4QOCOJ1 Nov 2020

Australian police trial facial recognition for COVID quarantine compliance

Australian police in New South Wales, Victoria, and Western Australia are trialling facial recognition software from Genvis to monitor people in home quarantine. Individuals are required to take selfies when randomly checked, and the software verifies their location and identity. Privacy advocates and the UN have raised concerns about surveillance overreach and potential human rights violations. The trials are voluntary, but critics warn of inaccuracies and mission creep.

Company involved
New South Wales Police Force, Victoria Police, Western Australia Police
AI system involved
Genvis facial recognition software

10 source articles · read the reporting →

WF-E6UIS121 Sep 2021

JR East scraps facial recognition plan for past offenders

JR East, a Japanese train operator, installed facial recognition cameras at stations to identify past offenders, named criminal suspects, and suspicious persons. After criticism over a lack of societal consent, the company announced on 21 September 2021 that it had unregistered past offenders from the system. The company stated it would reinstate the system once clearer guidelines are established. No actual harm was reported.

Company involved
JR East

7 source articles · read the reporting →

WF-UHO4KG31 Aug 2021

Met Police buys £3m retrospective facial recognition system

The Metropolitan Police Service (MPS) has awarded a £3 million, four-year contract to Northgate Public Services for a new retrospective facial-recognition (RFR) system to be deployed within three months. RFR processes biometric information from historic CCTV, social media, and other images to identify suspects and missing persons, operating retroactively unlike live facial recognition. The procurement was approved by the Mayor's Office for Policing and Crime in August 2021. The MPS states that human-in-the-loop decision-making will be used, but digital rights groups and a former biometrics commissioner have raised concerns about potential discrimination, overrepresentation of marginalised groups in watch lists, and lack of a legislative framework.

Company involved
Metropolitan Police Service
AI system involved
Retrospective facial-recognition software

9 source articles · read the reporting →

WF-BQBMHB4 Aug 2023

WorldCoin suspended in Kenya over data security concerns

WorldCoin, a digital identification protocol using iris scans, was suspended by Kenyan regulators (ODPC and Communications Authority) over concerns about data security, consent, and oversight. The system had issued digital IDs and cryptocurrency tokens to over 350,000 Kenyans. Reports of hacked orb operators and iris scans traded on the dark web have also emerged.

Company involved
Tools for Humanity GmbH
AI system involved
WorldCoin

10 source articles · read the reporting →

Five Illinois residents sue facial recognition company Pimeyes under BIPA

Five Illinois residents are suing Pimeyes, a facial recognition search engine, alleging that the company violated the Illinois Biometric Information Privacy Act by collecting and using their facial data without consent. The lawsuit claims that Pimeyes made the residents' photos and information available in search results, enabling unauthorized access. The company has not yet been served with the lawsuit, and its CEO stated he had no prior knowledge of the case.

Company involved
Pimeyes
AI system involved
Pimeyes

7 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-ROMQCH5 Feb 2024

OnlyFake site uses neural networks to generate fake IDs, bypasses OKX verification

An underground website called OnlyFake uses neural networks to generate realistic photos of fake IDs for $15. The journalist tested the service and obtained a convincing California driver's license. They then used another fake ID to successfully bypass the identity verification process on OKX, a cryptocurrency exchange. The article alleges that this technology could streamline bank fraud and money laundering, but reports no actual financial loss.

Company involved
OKX
AI system involved
OnlyFake

10 source articles · read the reporting →

Serco Leisure issued enforcement notices for unlawful biometric monitoring of employees

Serco Leisure and associated trusts used facial recognition and fingerprint scanning to monitor employee attendance at 38 leisure facilities. The ICO found they unlawfully processed biometric data of over 2,000 employees. Enforcement notices were issued ordering them to stop.

Company involved
Serco Leisure Operating Limited

8 source articles · read the reporting →

WF-2JX17425 Mar 2021

Italian DPA says Interior Ministry's Sari Real Time facial recognition lacks legal basis

The Garante per la protezione dei dati personali issued an opinion on Sari Real Time, a facial recognition system developed for the Italian Ministry of Interior. The system, yet to become operational, would compare live video footage of people in public areas with a watch-list and alert police operators. The authority found the planned biometric processing lacked a specific legal basis under Italian law and Directive (EU) 2016/680, and warned it could turn targeted surveillance into mass surveillance.

Company involved
Ministero dell'Interno – Dipartimento della pubblica sicurezza
AI system involved
Sari Real Time

10 source articles · read the reporting →

WF-YNC84Z9 Jul 2019

Facial recognition system falsely detains woman in Copacabana, Rio de Janeiro

A facial recognition system deployed by the Military Police of Rio de Janeiro in Copacabana falsely identified a local resident as a wanted fugitive. The system flagged the woman with a 70% probability match, leading police to detain her for over an hour before realising the error. The police spokesperson acknowledged the system's statistical error rate and stated that officers attempt to verify identities on site. The incident is one of several false positives reported with the system.

Company involved
Polícia Militar do Rio de Janeiro

10 source articles · read the reporting →

← Newerpage 2 of 3Older →