The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

188 incidents closest to “Document Fraud Detection” · matched on meaning · public reporting

WF-ZJ35TI1 Dec 2024

NBI raids Makati love scam facility using AI-generated fake female profiles

The National Bureau of Investigation raided a Makati condominium believed to be a love-scam facility, arresting about 100 suspects. The scammers used AI-generated conversations and fake profile pictures of women to trick victims into investing in fraudulent cryptocurrency schemes. Singaporean actor Laurence Pang said he lost S$35,000 after being deceived by such a scheme via the dating site PinaLove in late 2024; the PNP Anti-Cybercrime Group confirmed he was a victim. The NBI continues to interrogate a Chinese national said to be the supervisor.

2 source articles · read the reporting →

WF-JGUWF51 Mar 2024

South Korean police arrest 45 in deepfake romance scam defrauding 12 billion won

A criminal group in South Korea used deepfake technology to create a fictional woman and conducted romance scams via chat apps, defrauding over 100 victims of about 12 billion won. The victims included elderly, disabled, and small business owners. Police arrested 45 individuals and are seeking extradition of suspects abroad.

Company involved
Ulsan Police Agency
AI system involved
Deepfake technology

1 source article · read the reporting →

WF-YDH39P1 Jan 2013

Swedish welfare agency's AI system flags marginalized groups for fraud investigations

Försäkringskassan, Sweden's Social Insurance Agency, uses an AI risk-scoring system to flag welfare applicants for fraud investigations. The system disproportionately targets women, individuals with foreign backgrounds, low-income earners, and those without university degrees, according to an investigation by Lighthouse Reports and Svenska Dagbladet. Amnesty International has called for the system to be discontinued, citing violations of the right to equality and non-discrimination.

Company involved
Försäkringskassan (Swedish Social Insurance Agency)

6 source articles · read the reporting →

WF-ID19SZ1 Jan 2012

Dutch government to refund over 10,000 students over discriminatory DUO fraud algorithm

The Dutch government has pledged to refund over 10,000 students who were unjustly flagged for student finance fraud by a discriminatory algorithm used by the Education Executive Agency (DUO). The algorithm, implemented in 2012, used criteria that disproportionately targeted students from immigrant backgrounds, particularly those of Turkish and Moroccan descent. Following investigations by the Dutch Data Protection Authority and an independent report by PwC, the algorithm was suspended in July 2023 and replaced with a random-sampling system. The government has allocated 61 million euro for refunds.

Company involved
Education Executive Agency (DUO)
AI system involved
DUO fraud detection system

9 source articles · read the reporting →

WF-D2EVW81 Jan 2015

Dutch Ministry of Foreign Affairs used secret algorithm to score visa applicants based on nationality

The Dutch Ministry of Foreign Affairs used a secret algorithm called IOB to score short-stay visa applicants based on nationality, gender, and age. Applicants flagged as high risk were automatically moved to an intensive track with higher rejection rates and delays. The ministry's own data protection officer warned of potential ethnic discrimination, but the system continued to be used. The algorithm has profiled millions of applicants since 2015.

Company involved
Ministry of Foreign Affairs
AI system involved
IOB

10 source articles · read the reporting →

WF-0YQPL21 Jan 2019

iBorderCtrl lie detector falsely flagged honest reporter as liar

A journalist testing Europe's iBorderCtrl virtual policeman at the Serbian-Hungarian border gave honest answers but was deemed a liar by the system, scoring 48 out of 100 with four false answers flagged. The Hungarian policeman said the result suggested further checks, though none were carried out. The reporter only learned of the result after filing a data access request under European privacy laws. Experts and transparency activists have criticised the technology as pseudoscientific and potentially discriminatory.

Company involved
iBorderCtrl consortium
AI system involved
Silent Talker / iBorderCtrl virtual policeman

10 source articles · read the reporting →

WF-S94FL425 Apr 2019

Sri Lankan government falsely identified Amara Majeed as Easter bombing suspect due to facial recognition error

Amara Majeed testified to the Maryland General Assembly that Sri Lankan authorities falsely identified her as a suspect in the 2019 Easter bombings after an error in facial recognition technology. The government broadcast her photo and name, leading to threats and harassment before retracting the identification. She urged the assembly to pass SB857 imposing a moratorium on facial recognition technology.

Company involved
Sri Lankan government

4 source articles · read the reporting →

AI detectors falsely flag non-native English speakers' essays as AI-generated

A study by Stanford researchers found that seven popular AI text detectors wrongly flagged over half of essays written by non-native English speakers as AI-generated. The detectors assess text perplexity, and non-native speakers' simpler word choices lead to false positives. The researchers warn that this bias could have serious implications for students and job applicants, potentially leading to discrimination.

9 source articles · read the reporting →

Deepfake Trump video scam defrauds over 200 in Karnataka

An AI-generated video of Donald Trump promising quick returns scammed over 200 people across Karnataka, India, costing them more than ₹2 crore. Victims believed they were investing in 'Trump Hotel rentals' and saw fake earnings grow on their app until everything vanished. A police investigation is underway.

4 source articles · read the reporting →

DWP algorithm mistakenly flags 200,000 Housing Benefit claimants for fraud review

The UK Department for Work and Pensions (DWP) uses an algorithm to flag Housing Benefit claimants for possible fraud or error. According to a Big Brother Watch investigation, the algorithm has mistakenly flagged 200,000 innocent people, subjecting them to intrusive reviews. Only one in three flagged cases actually had errors, compared to two in three during the pilot. The DWP has spent £4.4 million on these pointless checks.

Company involved
Department for Work and Pensions (DWP)

6 source articles · read the reporting →

WF-DLNNBB1 Jan 2015

French police secretly used Briefcam facial recognition since 2015

The French National Police has been using Briefcam's Video Synopsis software since 2015, according to internal documents obtained by Disclose. The software, which includes facial recognition capabilities, was deployed without the required data protection impact assessment or notification to the CNIL. The Ministry of the Interior concealed the use of this tool for eight years. The police hierarchy allegedly used the software for facial recognition without judicial requisition, and the DGPN did not respond to requests for comment.

Company involved
French National Police
AI system involved
Briefcam Video Synopsis

10 source articles · read the reporting →

Audit of RisCanvi finds biases and reliability issues in criminal justice system

Eticas conducted an adversarial audit of RisCanvi, an AI risk assessment tool used in Catalonia's criminal justice system. The audit uncovered biases in risk classifications against specific demographics and significant reliability issues. The findings call for fairer practices in criminal justice AI.

Company involved
Catalonia's criminal justice system
AI system involved
RisCanvi

4 source articles · read the reporting →

WF-LIDYZZ1 Jan 2025

UK universities detect deepfake applicants in automated interviews

Some UK universities use Enroly's automated online interviews to screen international student applicants. Enroly detected about 30 cases of deepfake attempts out of 20,000 interviews during the January 2025 intake. The deepfakes used AI-generated images and audio to replace applicants' faces and voices. Enroly stated it caught the attempts using real-time detection methods.

Company involved
UK universities
AI system involved
Enroly

5 source articles · read the reporting →

WF-Q8FS1926 Oct 2025

Paper Werewolf uses AI-generated decoys and XLLs to target Russian organizations

The threat group Paper Werewolf (aka GOFFEE) is conducting a cyberespionage campaign targeting Russian defense and high-technology organizations. The campaign uses AI-generated decoy documents, such as invitations and official letters, to trick recipients into opening malicious Excel XLL add-ins that deliver a backdoor called EchoGather. The backdoor collects system information and communicates with a command-and-control server. The campaign is ongoing and was first detected in late October 2025.

Company involved
Paper Werewolf
AI system involved
EchoGather

2 source articles · read the reporting →

WF-9F92BD14 Nov 2019

UK prison risk algorithm may embed racial bias, experts warn

The Ministry of Justice developed a digital tool to categorize prisoners, which experts and advocacy groups warn could automate and embed racism. The tool uses intelligence data that may reflect existing bias, potentially leading to disproportionate categorization of BAME prisoners. The MoJ claims no evidence of discrimination, but critics question the small trial sample and lack of transparency.

Company involved
Ministry of Justice
AI system involved
Digital prisoner categorisation tool

5 source articles · read the reporting →

WF-L7RQG21 Mar 2025

Singapore Firm Defrauded of $499K in Deepfake CEO Video Call Scam

In March 2025, a finance director at a multinational firm in Singapore authorised a US$499,000 payment during a Zoom call that appeared to include the company's CFO and other executives. The call was a deepfake, with AI-generated likenesses and voices. The fraudsters used the impersonation to request an urgent fund transfer for a purported acquisition. The company later discovered the deception and reported it to Singapore police.

2 source articles · read the reporting →

WF-3RBX5G1 Jan 2021

Ukrainian Hacker Pleads Guilty to Operating OnlyFake AI ID Scam Site

Yurii Nazarenko, a Ukrainian national, pleaded guilty to running OnlyFake, an AI-powered website that generated and sold over 10,000 counterfeit identification documents globally. The site allowed users to create realistic fake IDs, including driver's licenses and passports, to bypass identity verification at banks and cryptocurrency exchanges. Nazarenko faces up to 15 years in prison and agreed to forfeit $1.2 million. Sentencing is scheduled for June 2026.

Company involved
OnlyFake
AI system involved
OnlyFake

3 source articles · read the reporting →

WF-QKEZP51 Jan 2025

Scammers Use AI to Create Fake Joann Fabrics Websites to Steal Credit Card Data

After Joann Fabrics filed for bankruptcy in January 2025, scammers used AI to create impostor websites mimicking the retailer's site. These fake sites offered deep discounts to trick shoppers into providing credit-card information and personal data. Customers who placed orders never received products and had their payment information compromised. The incident highlights the growing use of AI by cybercriminals to create convincing fake websites.

2 source articles · read the reporting →

Man uses AI face-swap to steal 15,996 yuan from financial accounts, sentenced to 4.5 years

A man in Jiangsu, China, illegally purchased 1.95 million personal records and used AI face-swapping software to bypass facial recognition on financial platforms. He accessed 23 victims' accounts, changed five passwords, and used one account to buy two phones worth 15,996 yuan. He was convicted of infringing citizens' personal information and credit card fraud, sentenced to four years and six months in prison, and ordered to pay damages and delete the data.

3 source articles · read the reporting →

Scammers use AI deepfakes to defraud Simcoe County residents of tens of thousands

Scammers are using AI-generated deepfake videos of public figures to promote fraudulent investment schemes, tricking residents of Simcoe County, Ontario, into transferring large sums of money via cryptocurrency. Victims, numbering at least half a dozen, have lost tens of thousands of dollars, with one losing over $100,000. The scammers, who pose as investment representatives, instruct victims to move money to crypto exchanges and then transfer it to untraceable addresses. MP Adam Chambers is calling for greater public awareness and platform accountability.

2 source articles · read the reporting →

FBI and ICE use state driver's license photos for facial recognition without consent

The FBI and ICE have been scanning millions of Americans' driver's license photos using facial recognition technology without their knowledge or consent, according to newly released documents. The agencies accessed state DMV databases, turning them into a facial-recognition gold mine. This practice raises significant privacy concerns as it was done without public awareness or legal oversight.

Company involved
FBI and ICE

1 source article · read the reporting →

WF-2CXT6S1 Jan 2018

SEC charges YouPlus and CEO with defrauding investors

The SEC charged machine-learning startup YouPlus and its CEO Shaukat Shamim with defrauding investors. Shamim allegedly made false statements about the company's revenue and customer numbers, including providing falsified bank statements. The scheme unravelled when Shamim confessed to investors that the company had earned less than $500,000 and had only four paying customers since 2013. The SEC is seeking permanent injunctions, civil penalties, and an officer-and-director bar.

Company involved
YouPlus
AI system involved
YouPlus machine-learning tool

1 source article · read the reporting →

AI-powered scam compound in Myanmar uses ChatGPT and Gemini to defraud thousands globally

Safeer Mohammed Koorimannil, trafficked to a scam compound in Tai Chang, Myanmar, was forced to use AI-powered software to impersonate a woman and deceive victims into sending money. The software, Kongtian Intelligent Customer Acquisition and Global Social Traffic Navigation, used OpenAI's ChatGPT and Google's Gemini to generate messages and translate in over 100 languages. Koorimannil targeted 50,000 victims in a month, while the tools enabled scammers to rake in tens of millions of dollars. U.S. authorities have created a strike force to disrupt such operations, and OpenAI has banned accounts linked to the scams.

Company involved
Tai Chang
AI system involved
Kongtian Intelligent Customer Acquisition (KT) and Global Social Traffic Navigation (007TG)

2 source articles · read the reporting →

WF-D5Q6XP27 Oct 2025

Deepfake scam articles impersonate Maltese ministers after budget day

After Malta's budget day on 27 October 2025, a series of scam articles featuring deepfake videos of ministers, including Economy Minister Silvio Schembri, appeared on social media. The articles, falsely branded as Times of Malta, promoted a fraudulent AI-powered trading platform called NethertoxAGENT, claiming a €215 investment would yield €850 weekly. The scam used fake testimonials and logos of reputable businesses to appear credible. Authorities have not reported any arrests for this specific scam, but a similar deepfake scam previously led to a woman losing her life savings and a money laundering charge against a Ukrainian national.

3 source articles · read the reporting →

← Newerpage 7 of 8Older →