ACLU test finds Rekognition falsely matches 27 New England athletes to mugshots
The ACLU of Massachusetts conducted a test using Amazon's Rekognition facial recognition technology, comparing headshots of 188 New England professional athletes to a database of 20,000 arrest photos. The software falsely matched 27 athletes, including Patriots safety Duron Harmon. The ACLU is calling for a moratorium on government use of face surveillance technology.
- Company involved
- ACLU of Massachusetts
- AI system involved
- Rekognition
8 source articles · read the reporting →
Researchers at Shanghai Jiao Tong University train neural network to identify criminals by their faces
Researchers at Shanghai Jiao Tong University used a convolutional neural network to classify facial photographs of 1,856 Chinese men aged 18 to 55, half of whom were criminals, and reported 89.5% accuracy in distinguishing criminals from non-criminals. The study, published on arXiv, identifies facial features the network relied on and raises ethical concerns about potential misuse in pre-crime surveillance. No deployment or actual harm is reported.
- Company involved
- Shanghai Jiao Tong University
8 source articles · read the reporting →
Duke University's PULSE AI upscaler turns Barack Obama white due to racial bias
Duke University researchers developed PULSE, an AI tool that upscales blurry face photos using Nvidia's StyleGAN model. When tested, it generated a white face from a pixelated image of Barack Obama, revealing racial bias. The bias stemmed from StyleGAN's training data being predominantly white and the evaluation dataset CelebA being 90% white. The researchers acknowledged the issue and updated their paper, while Nvidia stated it is working to mitigate bias.
- Company involved
- Duke University
- AI system involved
- PULSE
2 source articles · read the reporting →
MIT researchers used YouTube videos to train Speech2Face without consent
MIT researchers used YouTube videos, including one of Nick Sullivan, to train a model called Speech2Face that generates faces from voices. Sullivan discovered his data was used without his consent and expressed surprise. The researchers defended their use of public data, but the incident raised ethical questions about consent in AI research.
- Company involved
- Massachusetts Institute of Technology
- AI system involved
- Speech2Face
10 source articles · read the reporting →
MIT-IBM Watson AI Lab's AI Portrait Ars produces whitewashed portraits of people of colour
AI Portrait Ars, developed by researchers at the MIT-IBM Watson AI Lab, is reported to have generated Renaissance-style portraits that lightened the skin and altered the facial features of people of colour. The tool, trained on tens of thousands of paintings from the Western artistic tradition, was criticised for reproducing that bias in its data set. The creators acknowledged the bias but did not respond to a request for comment.
- Company involved
- MIT-IBM Watson AI Lab
- AI system involved
- AI Portrait Ars
10 source articles · read the reporting →
Kneron researchers bypass facial recognition at airport and train station using mask and photo
In December 2019, Kneron researchers tested facial recognition systems at a high-speed rail station in China, Schiphol Airport, point-of-sale terminals, and a mobile phone. Using a high-quality 3D mask and a photo on a phone screen, they successfully deceived the systems, gaining access and making purchases. The survey highlighted security shortfalls in many commercial facial recognition solutions.
- Company involved
- Schiphol Airport; high-speed rail station in China
10 source articles · read the reporting →
Apple Face ID fails to distinguish between siblings in video
A video posted on Reddit shows Apple's Face ID unlocking an iPhone X for a sibling who was not the enrolled user, after he put on glasses similar to his brother's. The system had been set up by the other brother, and the video demonstrates that Face ID can be fooled by siblings with similar facial features. Apple has acknowledged that Face ID may be less secure for siblings with similar appearances.
- Company involved
- Apple
- AI system involved
- Face ID
9 source articles · read the reporting →
Nvidia releases AI-powered Eye Contact feature for Broadcast app
Nvidia has released a beta version of Eye Contact, an AI-powered feature for its Broadcast app that replaces a user's eyes in video streams with simulated eyeballs that always face the camera. The feature is intended to maintain eye contact even when the user looks away, but social media response has been largely negative. A former TV news anchor said that unbroken eye contact can be regarded as creepy or uncomfortable.
- Company involved
- Nvidia
- AI system involved
- Eye Contact
8 source articles · read the reporting →
MBN introduces AI news anchor AI Kim in South Korea
MBN, a South Korean cable channel, introduced an AI-powered news anchor based on anchor Kim Ju-ha. The AI, named AI Kim, was created through deep learning using 10 hours of video of Kim. It presents news in her voice and manner, intended to allow 24/7 broadcasting.
- Company involved
- MBN
- AI system involved
- AI Kim
10 source articles · read the reporting →
Chinese propaganda network used AI-generated faces on Facebook
Facebook removed two networks of fake accounts spreading propaganda, one originating from China and one from the Philippines. The Chinese network used AI-generated faces created through Generative Adversarial Networks (GANs) to create fake profiles and evade detection. The campaign targeted the US election and Southeast Asia, pushing pro-China content. Facebook took down the accounts and published a report with Graphika.
- Company involved
- Chinese propaganda network (Fujian province)
- AI system involved
- GANs (Generative Adversarial Networks)
10 source articles · read the reporting →
DiveFace face-recognition dataset reuses Flickr photos despite licence restrictions
DiveFace is a face-recognition dataset published in 2019 with 139,677 images of about 24,000 people. The authors say the images came from Flickr via the MegaFace and YFCC100M datasets and were automatically labelled by gender and ethnicity. Exposing.ai found that many of the photos carry Creative Commons licences which prohibit derivative use, suggesting the dataset may have been assembled without proper permission. The dataset remains available from the authors' GitHub page.
- AI system involved
- DiveFace
3 source articles · read the reporting →
Zao deepfake app sparks privacy and fraud fears in China
The Zao face-swapping app, developed by Momo, sparked privacy and fraud fears after its launch in China on 29 August 2019. The app's terms and conditions initially gave the developer permanent rights to use users' images, which experts said broke Chinese law. Momo subsequently apologized and deleted the controversial clause. Alipay assured users that deepfakes could not bypass its facial recognition payment system.
- Company involved
- Momo
- AI system involved
- Zao
10 source articles · read the reporting →
FindFace facial recognition app used to out sex workers in Russia
The FindFace facial recognition app is being used by users of the Russian website Dvach to identify porn actresses and sex workers from images and match them to their VKontakte accounts. The users then spam the victims' families and friends with the information, aiming to out them. Several victims complained to FindFace, but the founder stated there was no way to prevent the misuse.
- Company involved
- FindFace
- AI system involved
- FindFace
7 source articles · read the reporting →
Deepfake creator Xiao swaps Yang Mi's face onto Athena Chu's body
A Chinese creator named Xiao used deepfake technology to superimpose actress Yang Mi's face onto Athena Chu's body in videos from a 1994 TV series. The videos went viral on Bilibili and Weibo, raising concerns about privacy and potential harassment. Xiao stated he made the videos to educate the public about deepfakes. The videos were later deleted.
10 source articles · read the reporting →
Faces of the Riot publishes extracted faces from Parler Capitol riot videos
The website Faces of the Riot used open source facial recognition software to extract and publish over 6,000 faces from Parler videos of the January 6 Capitol riot. The creator, an anonymous college student, aimed to help identify participants in the insurrection. The site has been criticised for privacy violations and potential vigilante misuse. The creator says they are working to remove non-rioter faces.
- Company involved
- Faces of the Riot
- AI system involved
- Faces of the Riot
8 source articles · read the reporting →
Qoves facial assessment tool ranks journalist's attractiveness and suggests procedures
Tate Ryan-Mosley, a journalist at MIT Technology Review, used Qoves Studio's AI facial assessment tool, which automatically scored her face and listed perceived flaws such as smile lines and under-eye bags. The tool recommended skin-care products and paid surgical consultation reports. She also tried Megvii's Face++ beauty-scoring system, which gave her two percentage attractiveness scores. The article raises concerns that such algorithms are inaccurate, biased and not transparently used by social media platforms.
- Company involved
- Qoves Studio
- AI system involved
- Facial Assessment Tool
9 source articles · read the reporting →
Retorio AI personality test swayed by candidate appearance in BR experiment
Bayerischer Rundfunk journalists conducted experiments with Retorio's AI video interview analysis tool. The AI, which assesses personality traits from short videos, produced different scores when the same actress changed her appearance (glasses, headscarf, wig) or the video background and lighting were altered. The start-up Retorio acknowledged that the AI considers external image, similar to a human interviewer. Experts warned that such software could perpetuate stereotypes and unfairly affect job candidates.
- AI system involved
- Retorio AI
10 source articles · read the reporting →
FTC settles with IntelliVision over deceptive facial recognition claims
The Federal Trade Commission (FTC) took action against IntelliVision Technologies Corp. for making false, misleading, or unsubstantiated claims about its AI-powered facial recognition software. The company allegedly claimed its software had one of the highest accuracy rates on the market and was free of gender or racial bias, without supporting evidence. The FTC also alleged that IntelliVision did not train its software on millions of faces as claimed, but on images of approximately 100,000 individuals. Under a proposed consent order, IntelliVision is prohibited from making such misrepresentations without competent and reliable testing.
- Company involved
- IntelliVision Technologies Corp.
- AI system involved
- IntelliVision facial recognition software
9 source articles · read the reporting →
Face recognition bypass used to register shell companies for tax fraud in Shanghai
In a major tax fraud case in Shanghai, criminals used face recognition cracking techniques to register shell companies on government platforms. They purchased high-resolution photos and used apps to create fake videos, then used modified phones to bypass face recognition authentication. The scheme resulted in fraudulent invoices totaling over 500 million yuan. The case was prosecuted by the Shanghai procuratorate.
7 source articles · read the reporting →
Deep-Live-Cam enables real-time face swapping, raising fraud concerns
A software package called Deep-Live-Cam has gone viral for enabling real-time face swapping on webcams using a single photo. The tool, which is free and open source, allows anyone to impersonate another person's appearance in a video chat, raising concerns about remote deception and fraud. The article notes that similar technology has been used in a $25 million heist in Hong Kong and in audio deepfake scams.
- AI system involved
- Deep-Live-Cam
7 source articles · read the reporting →
New Jersey court rules police must disclose facial recognition algorithms used to identify defendant
Francisco Arteaga was charged with armed robbery after a facial recognition search by the New York Police Department identified him as a possible match. The New Jersey police used this match to obtain witness identifications. Arteaga requested information about the facial recognition software, including its source code and error rate, but the trial court denied his request. The New Jersey appellate court ruled that the prosecution must disclose the algorithms, citing due process and the Brady rule.
- Company involved
- New Jersey Police
7 source articles · read the reporting →
ElevenLabs voice cloning tool used to create deepfake celebrity audio clips
Speech AI startup ElevenLabs launched a beta voice cloning tool. Within days, users on 4chan posted deepfake audio clips featuring voices resembling celebrities like Emma Watson reading offensive material. ElevenLabs acknowledged the misuse and said it is considering additional safeguards.
- Company involved
- ElevenLabs
- AI system involved
- ElevenLabs platform
10 source articles · read the reporting →
Short drama company YaoKe Media signs AI actors, sparking backlash over uncanny valley and likeness rights
On March 18, 2026, Chinese short drama company YaoKe Media announced the signing of two AI digital actors, Qin Lingyue and Lin Xiyan, and the production of an AI drama 'Qinling'. The AI actors, which resemble real celebrities like Zhao Jinmai, prompted netizens to call for rights protection on behalf of the real actors. Critics also complained about the 'uncanny valley' effect, with the term 'AI actor fake human feeling' trending on Weibo. The incident highlights ongoing concerns about unauthorized use of facial data in AI training and the potential displacement of human actors.
- Company involved
- 耀客传媒 (YaoKe Media)
- AI system involved
- 秦凌岳, 林汐颜 (AI actors) and AI drama 《秦岭》
5 source articles · read the reporting →
Woman discovers past photos via facial recognition search
A woman scanned her face on a facial recognition search engine and discovered old photographs from a traumatic period in her past that she believed were forgotten. The incident highlights privacy risks of facial recognition technology.
6 source articles · read the reporting →
