UK Court of Appeal Finds South Wales Police's Automated Facial Recognition Unlawful
The UK Court of Appeal ruled that South Wales Police's use of Automated Facial Recognition (AFR) technology, known as AFR Locate, was unlawful and violated human rights. The court found that the legal framework gave officers too much discretion over watchlists and deployment, and the data protection impact assessment was inadequate. Civil liberties campaigner Ed Bridges brought the judicial review, alleging the technology was unlawfully intrusive. The court upheld the appeal on grounds of legality, data protection, and equality duties, and South Wales Police stated it would not appeal the decision.
- Company involved
- South Wales Police
- AI system involved
- AFR Locate
8 source articles · read the reporting →
Grok and Google Lens AI overviews falsely claim fake images show Huntingdon train attack
Grok and Google Lens AI overviews have been claiming that AI-generated images of the Huntingdon train attack are real. Grok told users one image was a genuine photo, while Google Lens claimed it was a still from a BBC news report. The AI systems also linked unrelated videos to the attack. Full Fact contacted Google, which told users they can provide feedback on errors. xAI has not yet responded.
- Company involved
- xAI and Google
- AI system involved
- Grok and Google Lens AI overviews
4 source articles · read the reporting →
Civil Society Demands Halt to AI Facial Recognition Tracking System by South Korean Government
South Korea's Ministry of Justice and Ministry of Science and ICT are building an AI identification and tracking system using facial recognition for airport immigration. It was revealed that over 170 million facial photos of citizens and foreigners were transferred to private companies for AI training without proper legal basis. Civil society groups held a press conference on November 9, 2021, condemning the project as an unprecedented violation of information human rights and demanding its immediate halt. They argue the data transfer violates the Personal Information Protection Act and have requested a meeting with the Minister of Justice.
- Company involved
- Ministry of Justice and Ministry of Science and ICT
- AI system involved
- AI Identification and Tracking System
5 source articles · read the reporting →
Ukraine defence ministry uses Clearview AI facial recognition to identify dead and Russian assailants
Ukraine's defence ministry has started using Clearview AI's facial recognition technology to identify Russian assailants and the dead, according to reports. Clearview provided free access to its system, which holds over 10 billion images including from Russian social media. Critics warn that the technology could misidentify people at checkpoints and in battle, potentially harming civilians. Clearview says it should not be used as the sole source of identification.
- Company involved
- Ukraine's Ministry of Defense
- AI system involved
- Clearview AI
10 source articles · read the reporting →
AI or Not detector mislabels real war photo as AI-generated
The AI image detection tool AI or Not, made by Optic, incorrectly labeled a photograph of a burnt corpse from the Israel-Gaza war as AI-generated. The image was originally tweeted by Israeli officials and later shared by commentators. Experts, including UC Berkeley professor Hany Farid, confirmed the image is real based on structural consistency and shadows. The false detection contributed to disinformation about the war. Optic did not respond to requests for comment.
- Company involved
- Optic
- AI system involved
- AI or Not
10 source articles · read the reporting →
Spamouflage Operation Used AI-Generated Deepfake Videos for Pro-Chinese Influence
In late 2022, Graphika observed the pro-Chinese influence operation Spamouflage promoting videos featuring AI-generated fictitious people. The footage was created using a commercial AI video platform from a UK company. The videos were low-quality and received fewer than 300 views, but Graphika warns that such tools could enable more convincing deception at scale.
- Company involved
- Spamouflage
5 source articles · read the reporting →
West New York Police's use of facial recognition led to wrongful arrest and four-year detention
Francisco Arteaga was charged with armed robbery in 2019 after facial recognition technology used by West New York police matched his mugshot to surveillance footage. He denied involvement and had an alibi, but was detained for nearly four years. A state appellate court ruled in 2023 that he was entitled to information about the technology, but prosecutors said they could not provide it because the match was made by the NYPD. Arteaga ultimately pleaded guilty to secure his release, and advocates say the case highlights the lack of transparency and regulation around police use of facial recognition.
- Company involved
- West New York Police Department
1 source article · read the reporting →
SenseNets silent after data leak exposes millions of people's records
SenseNets Technology Ltd., a Shenzhen-based facial recognition company, left a database containing personal information of more than 2.5 million people publicly accessible without password protection for months. Dutch security researcher Victor Gevers and the GDI Foundation discovered the exposure in July and warned the company, which did not respond. The database was secured in February after the leak was reported, and the company is reported to be conducting an internal investigation. SenseNets has declined to comment publicly.
- Company involved
- SenseNets Technology Ltd.
10 source articles · read the reporting →
ACLU test finds Rekognition falsely matches 27 New England athletes to mugshots
The ACLU of Massachusetts conducted a test using Amazon's Rekognition facial recognition technology, comparing headshots of 188 New England professional athletes to a database of 20,000 arrest photos. The software falsely matched 27 athletes, including Patriots safety Duron Harmon. The ACLU is calling for a moratorium on government use of face surveillance technology.
- Company involved
- ACLU of Massachusetts
- AI system involved
- Rekognition
8 source articles · read the reporting →
Companies face AI deepfake job candidates for remote roles
US companies report a surge in fake job seekers using generative AI tools to fabricate identities, employment histories, and conduct deepfake video interviews for remote positions. Cybersecurity firms Pindrop and CAT Labs, along with BrightHire, describe incidents where scammers, including North Korean operatives, attempted to gain employment to install malware, demand ransoms, steal data, or collect salaries fraudulently. One candidate, 'Ivan X', was detected by Pindrop's video authentication tool after a recruiter noticed his facial expressions were out of sync with his words.
- Company involved
- Pindrop Security
- AI system involved
- video authentication program
1 source article · read the reporting →
Microsoft funded Israeli facial recognition firm surveilling West Bank Palestinians
Microsoft invested in AnyVision, an Israeli facial recognition company whose technology powers a secret military surveillance project in the West Bank. The system, called Better Tomorrow, identifies and tracks Palestinians in live camera feeds. Microsoft said it would audit AnyVision for compliance with its ethical principles.
- Company involved
- Israeli Defense Forces
- AI system involved
- Better Tomorrow
10 source articles · read the reporting →
NYPD facial recognition cameras target non-white neighborhoods, reinforcing racist policing
Amnesty International's research found that NYPD's facial recognition cameras are disproportionately concentrated in non-white neighborhoods across New York City, particularly the Bronx, Brooklyn, and Queens. The communities most targeted by stop-and-frisk policing are also more exposed to this surveillance, which Amnesty calls a 'digital stop-and-frisk'. The NYPD used facial recognition in over 22,000 cases between 2016 and 2019, and refused to disclose records about its acquisition and use of the technology. Amnesty International has sued the NYPD and is calling for a ban on facial recognition for mass surveillance.
- Company involved
- New York Police Department
- AI system involved
- Argus camera system
1 source article · read the reporting →
Chinese police use face recognition to monitor Uyghur minority
Chinese police departments in multiple provinces have deployed facial recognition systems from AI companies such as Yitu, Megvii, SenseTime, and CloudWalk to identify and track Uyghur people, a Muslim minority. The systems scan crowds and trigger alerts when a Uyghur individual is detected, enabling targeted surveillance across cities including Hangzhou, Wenzhou, and Sanmenxia. Documents and interviews show that one system in Sanmenxia conducted over 500,000 screenings in a month, flagging thousands as Uyghur. Police use this technology to monitor and control the Uyghur population, who have been subjected to mass detention and other repressive measures. The article reports these practices from interviews with anonymous sources and procurement documents.
- Company involved
- Chinese police departments (various provinces)
10 source articles · read the reporting →
Swedish police fined for unlawful use of Clearview AI facial recognition
Sweden's data protection authority IMY fined the Swedish Police Authority €250,000 for unlawfully using Clearview AI's facial-recognition app. The police used the app between autumn 2019 and March 2020 without authorisation or a required data protection impact assessment. The IMY ordered the police to ensure Clearview AI deletes the data and to train employees to avoid future breaches.
- Company involved
- Swedish Police Authority
- AI system involved
- Clearview AI
3 source articles · read the reporting →
Workaround compiled Instagram selfies into face-mask facial recognition training set
Workaround, an AI startup, published the COVID19 Mask Image Dataset in April 2020, containing more than 1,200 photographs of people wearing face masks scraped from Instagram without their knowledge or consent. The dataset was intended to help train facial recognition algorithms so they could identify people whose faces are partly covered during the COVID-19 pandemic. The firm's chief executive acknowledged that the people pictured were not asked for permission and were unaware they were included. Facebook said it was investigating and does not allow third parties to use photos in this way without consent.
- Company involved
- Workaround
- AI system involved
- COVID19 Mask Image Dataset
10 source articles · read the reporting →
Macy's sued for using Clearview AI facial recognition without consent
A Chicago woman, Isela Carmean, filed a class-action lawsuit against Macy's, alleging the department store used Clearview AI facial recognition technology to identify customers without their consent, violating Illinois' Biometric Information Privacy Act. The lawsuit claims Macy's sent customer images from store surveillance to Clearview's database to obtain personal information. Macy's declined to comment on the pending litigation.
- Company involved
- Macy's
- AI system involved
- Clearview AI
10 source articles · read the reporting →
CivitAI hosts AI models generating non-consensual porn of real people
A 404 Media investigation found that CivitAI, a platform for sharing AI image generation models, hosts numerous models that can produce pornographic images of real people without their consent. These models are trained on images scraped from the internet, and have been downloaded tens of thousands of times, enabling widespread creation of non-consensual sexual content. Sex workers and public figures are particularly affected, with no remediation or recourse reported.
- Company involved
- CivitAI
7 source articles · read the reporting →
PimEyes face search engine found photos of journalists without consent
The New York Times tested PimEyes, a face search engine, by submitting photos of a dozen employees. The system returned photos of the journalists from various sources, including ones they had never seen, even when faces were obscured. The system also misidentified women journalists as possibly being on adult sites. German authorities are currently investigating PimEyes over privacy concerns.
- Company involved
- PimEyes
- AI system involved
- PimEyes
2 source articles · read the reporting →
Clearview AI tested facial recognition surveillance cameras with UFT and Rudin
Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.
- Company involved
- Clearview AI
- AI system involved
- Insight Camera
9 source articles · read the reporting →
FindFace facial recognition app used to out sex workers in Russia
The FindFace facial recognition app is being used by users of the Russian website Dvach to identify porn actresses and sex workers from images and match them to their VKontakte accounts. The users then spam the victims' families and friends with the information, aiming to out them. Several victims complained to FindFace, but the founder stated there was no way to prevent the misuse.
- Company involved
- FindFace
- AI system involved
- FindFace
7 source articles · read the reporting →
Faces of the Riot publishes extracted faces from Parler Capitol riot videos
The website Faces of the Riot used open source facial recognition software to extract and publish over 6,000 faces from Parler videos of the January 6 Capitol riot. The creator, an anonymous college student, aimed to help identify participants in the insurrection. The site has been criticised for privacy violations and potential vigilante misuse. The creator says they are working to remove non-rioter faces.
- Company involved
- Faces of the Riot
- AI system involved
- Faces of the Riot
8 source articles · read the reporting →
Qoves facial assessment tool ranks journalist's attractiveness and suggests procedures
Tate Ryan-Mosley, a journalist at MIT Technology Review, used Qoves Studio's AI facial assessment tool, which automatically scored her face and listed perceived flaws such as smile lines and under-eye bags. The tool recommended skin-care products and paid surgical consultation reports. She also tried Megvii's Face++ beauty-scoring system, which gave her two percentage attractiveness scores. The article raises concerns that such algorithms are inaccurate, biased and not transparently used by social media platforms.
- Company involved
- Qoves Studio
- AI system involved
- Facial Assessment Tool
9 source articles · read the reporting →
Huawei and Megvii tested Uyghur alarm facial recognition system
Huawei and Megvii conducted an interoperability test in 2018 that verified a 'Uyghur alarm' function in Megvii's facial recognition system, according to a confidential report found by IPVM. The system could identify Uyghur minorities and alert police. Huawei denied real-world application and deleted the report after IPVM inquired. Megvii denied targeting ethnic groups. The test report was publicly accessible on Huawei's European website.
- Company involved
- Huawei
- AI system involved
- Megvii Dynamic Face Recognition
10 source articles · read the reporting →
Clearview AI to pull out of Canada and stop working with RCMP amid privacy investigation
Clearview AI, the US facial recognition company, has agreed to stop offering its services in Canada amid a joint investigation by Canadian privacy regulators. The company's technology, which matches images against billions of photos scraped from the internet, was used by the RCMP and more than 20 other police services across Canada. The Office of the Privacy Commissioner of Canada announced the 'indefinite suspension' of Clearview's contract with the RCMP, its last remaining Canadian client. The investigation into whether the technology breaches Canadian privacy laws will continue.
- Company involved
- Clearview AI
- AI system involved
- Clearview AI
10 source articles · read the reporting →
