French police secretly used Briefcam facial recognition since 2015
The French National Police has been using Briefcam's Video Synopsis software since 2015, according to internal documents obtained by Disclose. The software, which includes facial recognition capabilities, was deployed without the required data protection impact assessment or notification to the CNIL. The Ministry of the Interior concealed the use of this tool for eight years. The police hierarchy allegedly used the software for facial recognition without judicial requisition, and the DGPN did not respond to requests for comment.
- Company involved
- French National Police
- AI system involved
- Briefcam Video Synopsis
10 source articles · read the reporting →
Delhi Police use facial recognition to screen PM Modi rally attendees
Delhi Police used an Automated Facial Recognition System (AFRS) to screen crowds at Prime Minister Narendra Modi's rally on December 22, 2019. The system, originally installed to find missing children, was used to identify possible disruptions. Privacy advocates called the move illegal and unconstitutional, saying it amounts to mass surveillance. Police defended the use, citing credible intelligence about possible disruptions.
- Company involved
- Delhi Police
- AI system involved
- Automated Facial Recognition System (AFRS)
6 source articles · read the reporting →
Oversight Board considers AI-manipulated Ronaldo video promoting gambling
In September 2024, a user posted an AI-manipulated video that appeared to show Brazilian footballer Ronaldo Nazário endorsing the Plinco app, but the link led to a different game. The video was viewed about 600,000 times. A user reported it to Meta as fraud, but Meta initially left it up. After the Oversight Board selected the case, Meta acknowledged the error and removed the post for violating its fraud and spam policies.
- Company involved
- Meta
2 source articles · read the reporting →
Developer iperov releases DeepFaceLive real-time face-swap AI on GitHub
The developer iperov has published DeepFaceLive, a neural network for real-time face swapping, on GitHub. The tool automatically replaces a user's face in live streams and video calls with a nonexistent model or a celebrity, and the installation instructions are simple. The developer claims 95% of deepfakes on YouTube were made with the related DeepFaceLab. No specific harm is reported, but the article highlights the tool's potential for misuse.
- Company involved
- iperov
- AI system involved
- DeepFaceLive
7 source articles · read the reporting →
Meta's AI sticker tool generates lewd, rude, and nude images
Meta's new AI-generated sticker feature on Facebook Messenger allowed users to create inappropriate images, including child soldiers, nude politicians, and sexualised characters. The tool, powered by Meta's Llama 2 model, was found to have insufficient content filters, enabling users to bypass restrictions with typos. Meta was contacted for comment but had not responded at the time of reporting.
- Company involved
- Meta
- AI system involved
- AI-generated sticker tool
1 source article · read the reporting →
Facebook failed to block thousands of political ads with false information
The Bureau of Investigative Journalism found over 8,000 misleading ads on Facebook featuring AI-manipulated videos and false information about European politicians. The ads evaded Meta's automated and human review systems, with fewer than half removed at the time of analysis. Meta stated that its systems removed nearly all ads at the time they were run, but the investigation found ads circulating for up to 37 days. The ads promoted investment scams and used deepfakes of politicians.
- Company involved
- Meta
- AI system involved
- Facebook ad review system
1 source article · read the reporting →
Facebook AI bans female photography charity Hundred Heroines due to word confusion
Facebook's AI content moderation system banned the British charity Hundred Heroines for ten years, mistakenly confusing the word 'heroine' with the illegal drug 'heroin'. The charity, which promotes women in photography, was unable to resolve the issue through repeated attempts to contact Facebook. It has created a new page, HH Museum, as a temporary workaround while the original page remains banned.
- Company involved
- Facebook
3 source articles · read the reporting →
PimEyes facial recognition search engine identifies individuals from public photos
PimEyes, a Polish facial recognition search engine, allows users to upload a photo and find matching images from across the internet. The system scrapes billions of photos and creates biometric profiles without consent. A banker named Dylan (pseudonym) discovered that an old party photo of him was found by the system, potentially outing his private life. Privacy advocates and platforms like Instagram and YouTube are taking action against PimEyes, alleging violations of the GDPR.
- Company involved
- PimEyes
- AI system involved
- PimEyes
6 source articles · read the reporting →
Deepfake adverts using Barbara O'Neill's likeness promote fake prostate cures
AI-generated deepfake videos impersonating Australian naturopath Barbara O'Neill are circulating on Facebook, falsely endorsing a cure for prostate problems and erectile dysfunction. The videos, which have millions of views, are part of a scam to sell products or phish for personal information. Africa Check found the videos to be deepfakes, with audio out of sync and posted by accounts unaffiliated with O'Neill, who has previously warned about such impersonations.
2 source articles · read the reporting →
Tencent launches Zero-Point Cruise facial recognition to enforce night-time game curfew
Tencent has introduced a feature called Zero-Point Cruise in its games, which subjects accounts registered as adults that play at night beyond a set time to facial recognition. Anyone who refuses or fails the verification is treated as a minor and logged out. Tencent says this is intended to stop children using adult identities to evade the game curfew, and that adults who mistakenly refuse can wait for the next authentication.
- Company involved
- Tencent
- AI system involved
- 零点巡航 (Zero-Point Cruise)
10 source articles · read the reporting →
Facebook's 'People You May Know' feature reveals psychiatrist's patients to each other
A psychiatrist discovered that Facebook's 'People You May Know' feature was recommending her patients as friends to each other and to her, despite no apparent connection. One patient saw friend suggestions for older and infirm people he did not know, who were later recognized as the psychiatrist's patients. Another patient saw a fellow patient from the office elevator, revealing their full name and profile. Facebook could not explain the specific cause but suggested phone contact syncing may have been responsible.
- Company involved
- Facebook
- AI system involved
- People You May Know
2 source articles · read the reporting →
Man uses AI face-swap to steal 15,996 yuan from financial accounts, sentenced to 4.5 years
A man in Jiangsu, China, illegally purchased 1.95 million personal records and used AI face-swapping software to bypass facial recognition on financial platforms. He accessed 23 victims' accounts, changed five passwords, and used one account to buy two phones worth 15,996 yuan. He was convicted of infringing citizens' personal information and credit card fraud, sentenced to four years and six months in prison, and ordered to pay damages and delete the data.
3 source articles · read the reporting →
Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal
Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.
- Company involved
- Secretaria de Segurança Pública da Bahia
2 source articles · read the reporting →
Deepfake video of CBS anchor and suspect in Frisco stabbing spreads online
An AI-generated deepfake video manipulated a CBS News Texas anchor's image and created a fake video of the suspect in a Frisco high school stabbing. The video was posted on Instagram and reposted on multiple accounts before being taken down. The incident highlights the growing ease of creating convincing deepfakes and the spread of misinformation online.
1 source article · read the reporting →
Google contractors targeted homeless people for Pixel 4 facial recognition data
Google hired Randstad to collect facial data to train the Pixel 4's face recognition system. Contractors allegedly targeted homeless people and unaware students, using deceptive tactics such as calling it a "selfie game" and offering $5 without informing subjects they were being recorded. Google suspended the research program and opened an investigation following the report.
- Company involved
- Google
- AI system involved
- Pixel 4 facial recognition
1 source article · read the reporting →
Clearview AI facial recognition app scrapes billions of images and is used by police
Clearview AI, a secretive start-up, built a facial recognition app that matches photos to a database of more than three billion images scraped from social media and websites. More than 600 law enforcement agencies, including the FBI and Department of Homeland Security, have used the tool to identify suspects in crimes such as shoplifting, identity theft and murder. The company monitored officers who ran a reporter's photo through the app, and its founder acknowledged designing an augmented-reality prototype but said there were no plans to release it. Critics warned the tool could end anonymity and enable misuse.
- Company involved
- Clearview AI
- AI system involved
- Clearview AI facial recognition app
2 source articles · read the reporting →
Facebook's On This Day feature resurfaces painful memories of deceased friends
In 2015, Facebook's 'On This Day' feature automatically resurfaced old posts, showing users like Sean Forbes and Eric Meyer distressing memories, including posts about friends who had died by suicide and a deceased child. The algorithm could not discern sentiment, causing emotional harm. Facebook acknowledged the issue, stating it had filters for memorialized accounts and relationship changes, but users could not fully opt out. Critics argued that automated nostalgia is inherently risky and that users need more control.
- Company involved
- Facebook
- AI system involved
- On This Day
1 source article · read the reporting →
Xuhui police expand facial recognition surveillance to profile 1.1 million residents
The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.
- Company involved
- Shanghai Municipal Bureau of Public Security, Xuhui District Branch
- AI system involved
- Intelligent Image Recognition System
3 source articles · read the reporting →
CA Press Wing warns of AI deepfake videos falsely showing Yunus endorsing gambling
The CA Press Wing warned that AI-generated deepfake videos of Chief Adviser Muhammad Yunus are being used in gambling ads on social media. The manipulated footage, taken from genuine interviews, falsely depicts Yunus promoting betting apps. The government urged the public to be cautious and not be deceived by these fake endorsements.
2 source articles · read the reporting →
Facebook's automated ad system rejects adaptive fashion ads
Small adaptive fashion companies have had their advertisements repeatedly rejected by Facebook's automated advertising system, which misidentifies their products as medical devices. The system's inability to understand context leads to discrimination against people with disabilities. Facebook has acknowledged the issue and restored some ads, but the problem persists, highlighting biases in machine learning.
- Company involved
- Facebook
- AI system involved
- Facebook automated advertising review system
2 source articles · read the reporting →
Manipulated AI video falsely shows Ahmed Dogan calling DPS members to protest
A manipulated video falsely shows Movement for Rights and Freedoms (DPS) honorary chairman Ahmed Dogan calling on party members to protest to protect his wealth. The deepfake video uses authentic footage from a 27 August 2024 DPS meeting and overlays AI-generated audio. It was first shared on TikTok by a satirical account and later spread on Facebook by anonymous profiles.
- Company involved
- Movement for Rights and Freedoms
- AI system involved
- deepfake
2 source articles · read the reporting →
Meta fails to block hate speech ads in Kenya test
Global Witness and Foxglove submitted test ads containing violent hate speech in English and Swahili to Facebook. The ads were approved for publication, demonstrating that Meta's content moderation systems failed to detect the hate speech. The groups had previously conducted similar tests in Myanmar and Ethiopia with the same result. Meta did not respond to the groups' outreach.
- Company involved
- Meta
- AI system involved
- Facebook's content moderation system
2 source articles · read the reporting →
NYPD Facial Recognition Leads to Wrongful Arrest of Trevis Williams
In April 2025, Trevis Williams was arrested by the NYPD after a facial recognition program matched his mug shot to a suspect in a February flashing incident, despite an eight-inch height difference and alibi evidence. The victim identified him from the AI-suggested photo array. Mr. Williams spent over two days in jail before the case was dismissed in July. The incident highlights the risks of using facial recognition on low-quality surveillance images.
- Company involved
- New York Police Department
2 source articles · read the reporting →
Facebook's moderation systems fail to detect ISIS propaganda network
A report by the Institute for Strategic Dialogue found that a network of ISIS supporters evaded Facebook's automated and manual moderation systems for months, spreading terrorist content that garnered tens of thousands of views. The network used tactics such as blurring logos and adding news branding to avoid detection. Facebook removed the accounts after being alerted, but the network adapted by shifting to new accounts.
- Company involved
- Facebook
1 source article · read the reporting →
