South African government departments suspend officials over AI-generated fake sources
The South African Department of Communication and Digital Technology and Department of Home Affairs suspended four officials after discovering that AI-generated fictitious references were used in policy documents. The Draft National Artificial Intelligence Policy was withdrawn from public consultation, and the Revised White Paper on Citizenship, Immigration, and Refugees was also affected. The departments are investigating and have appointed independent law firms to review all policy documents since November 2022. The ministers have pledged to implement AI verification checks in future policy approval processes.
- Company involved
- Department of Communication and Digital Technology; Department of Home Affairs
3 source articles · read the reporting →
Turnitin's AI Detector Falsely Flags Student's Essay as AI-Generated
A Washington Post test of Turnitin's new AI writing detector found it erroneously flagged 8% of a high school student's original essay as likely generated by ChatGPT. The student, Lucy Goetz, had not used AI, raising concerns about false accusations of cheating. Turnitin acknowledged the issue and added a caution flag, but educators worry about the potential for baseless academic-integrity investigations. The incident highlights the challenges of detecting AI-generated text and the need for careful human review.
- Company involved
- Turnitin
- AI system involved
- Turnitin AI writing detector
1 source article · read the reporting →
Federal judges admit staff used AI resulting in fictitious rulings
Two US district judges admitted that rulings issued under their names contained fabricated elements due to staff use of artificial intelligence tools. Judge Julien Neals in New Jersey and Judge Henry Wingate in Mississippi disclosed the errors in letters to the Administrative Office of the US Courts. The admissions came in response to questions from Senate Judiciary Committee Chairman Chuck Grassley. The incidents have raised concerns about judicial scrutiny of documents.
- Company involved
- US District Court for the District of New Jersey and US District Court for the Southern District of Mississippi
2 source articles · read the reporting →
Home Office sham marriage algorithm raises discrimination fears
The Home Office uses an algorithm to triage marriage visa applications, flagging couples as 'red light' or 'green light' based on undisclosed criteria. The system reportedly flags 20-25% of couples where one partner is from certain countries like Bulgaria, Greece, Romania, or Albania, and considers age gaps. Critics warn this could lead to indirect discrimination by nationality and age, potentially causing genuine couples to be investigated and deported. The Home Office defended the system, stating its equality impact assessment is designed to detect bias.
- Company involved
- Home Office
4 source articles · read the reporting →
UAE Company Loses $35 Million in Deepfake Audio Scam
Fraudsters used forged emails and deepfake audio to impersonate a company director, convincing a branch manager at a UAE company to transfer $35 million as part of a fake acquisition. The manager believed he was following instructions from the director and a US-based lawyer. The incident, which occurred in January 2020, led to a US federal court request for assistance in tracing the stolen funds. The case highlights the growing threat of deepfake technology in corporate fraud.
6 source articles · read the reporting →
Deepfake scams impersonate relatives in video calls to steal money in Vietnam
In March 2023, scammers used deepfake technology to create fake video calls impersonating relatives of victims in Ho Chi Minh City, Vietnam. One victim lost nearly 100 million VND after a video call that appeared to show his relative asking for a loan. Another victim lost 150 million VND in a similar scam. Police have received multiple reports and are investigating, warning that deepfake-enabled fraud is proliferating.
2 source articles · read the reporting →
Yozgat gang used AI deepfakes to defraud 33 people of 15 million lira
In Yozgat, Turkey, a criminal gang produced AI-generated deepfake videos to impersonate trusted figures and defraud 33 people of approximately 15 million Turkish lira. Police conducted simultaneous raids across four provinces, arresting nine suspects; six were jailed and three released on judicial control. The incident highlights the growing use of deepfakes in investment and romance scams.
1 source article · read the reporting →
U.S. Department of Homeland Security Uses Secret Algorithm ATLAS to Flag Naturalized Citizens for Denaturalization
The U.S. Department of Homeland Security operates a secret algorithm called ATLAS that screens naturalized citizens for potential fraud or national security concerns, flagging them for denaturalization. The system, hosted on Amazon Web Services, analyzes biometric and other data from various federal databases, and its rules are undisclosed. Human reviewers then decide whether to refer flagged individuals to Immigration and Customs Enforcement for possible deportation. Critics allege the algorithm relies on inaccurate data and lacks transparency, leading to wrongful denaturalization proceedings.
- Company involved
- U.S. Department of Homeland Security
- AI system involved
- ATLAS
2 source articles · read the reporting →
Scammers used AI-generated faces to pose as a Boston law firm
Scammers used a website and AI-generated faces to create a fake law firm called Arthur Davidson and sent a DMCA copyright infringement notice to a blogger. The blogger investigated and discovered the lawyers' photos were created by a generative adversarial network and the firm's website contained many red flags. The website was shut down shortly after the blogger contacted a company on whose behalf the notice was allegedly sent.
- Company involved
- Arthur Davidson
- AI system involved
- This Person Does Not Exist
1 source article · read the reporting →
Montenegro police warn of rising AI identity abuse in online fraud
Montenegrin police say AI is fuelling a rise in identity abuse by online fraudsters, using deepfake videos of public figures to promote bogus remedies and investment schemes. Surgeon and MP Vladimir Dobricanin found a manipulated video of himself apparently endorsing eyedrops and other products, while Bosnian fact-checkers reported similar misuse of statements to lure people into cryptocurrency scams. Victims reported 42 online scams in 2025 with financial losses of around 300,000 euros, but authorities say investigations are complex and often lengthy due to the use of servers abroad and encryption. Experts called for stronger technical capacities, international cooperation, and faster platform responses to tackle the problem.
- Company involved
- Limited Charm
- AI system involved
- Deepfake social media advertisements
1 source article · read the reporting →
Home Office passport photo checker biased against dark-skinned women
A BBC investigation found the UK Home Office's online passport photo checker was biased against people with darker skin, particularly women. Dark-skinned women were more than twice as likely to be told their photos failed rules compared to lighter-skinned men. One black student, Elaine Owusu, was repeatedly told her mouth looked open despite it being closed. The Home Office said the tool helps users submit correct photos and that systems are improving.
- Company involved
- Home Office
1 source article · read the reporting →
Douglas v. Deutsche Bank National Trust Company (D.C. Court of Appeals): AI-hallucinated content in court filing, Brief Stricken; Bar Referral
The AI generated fake legal citations that were included in an appellate brief, misleading the court and the opposing party.
- AI system involved
- Google AI
1 source article · read the reporting →
Companies face AI deepfake job candidates for remote roles
US companies report a surge in fake job seekers using generative AI tools to fabricate identities, employment histories, and conduct deepfake video interviews for remote positions. Cybersecurity firms Pindrop and CAT Labs, along with BrightHire, describe incidents where scammers, including North Korean operatives, attempted to gain employment to install malware, demand ransoms, steal data, or collect salaries fraudulently. One candidate, 'Ivan X', was detected by Pindrop's video authentication tool after a recruiter noticed his facial expressions were out of sync with his words.
- Company involved
- Pindrop Security
- AI system involved
- video authentication program
1 source article · read the reporting →
Fraudsters use AI voice deepfake to trick UK energy firm CEO into transferring $243,000
In March 2019, criminals used commercially available AI voice-generation software to impersonate the CEO of a German parent company. They tricked the CEO of a UK-based energy firm into urgently wiring $243,000 to a Hungarian supplier. The fraud was discovered when the fraudsters attempted a second transfer, which the CEO refused. The company was insured and the loss was covered.
- Company involved
- Unnamed UK-based energy firm
- AI system involved
- Commercially available voice-generating AI software
10 source articles · read the reporting →
Dutch government continued SyRI welfare fraud profiling after ban
The Dutch government deployed the SyRI algorithm to profile welfare recipients in low-income neighborhoods, despite a 2020 court ruling that the system violated EU human rights. The algorithm flagged thousands of parents for fraud based on illegal risk factors such as dual nationality, leading to false accusations, bankruptcy, and trauma. The government has announced an external review of the practices.
- Company involved
- Ministry of Social Affairs of the Netherlands
- AI system involved
- SyRI
10 source articles · read the reporting →
Guangxi homeowners lose homes in facial recognition fraud
Over 10 homeowners in Guangxi, China, were defrauded by a real estate agent who used the government's '邕e登' app to transfer their property without consent. The agent tricked them into using facial recognition for what they thought was file checking, but instead the system processed property transfers. The agent has been arrested and the case is under investigation. The local government has restricted the properties and plans to upgrade the app's security.
- Company involved
- 南宁市自然资源局
- AI system involved
- 邕e登
10 source articles · read the reporting →
EU to trial AI lie detector at airports in Hungary, Latvia, Greece
The European Union is set to trial an AI-powered lie detector system called iBorderCtrl at airports in Hungary, Latvia and Greece. The system uses a virtual avatar to question passengers and monitors their facial expressions to detect deception. Privacy groups have raised concerns about bias and error rates, noting that the technology has only been tested on 32 people. The trial will require passenger consent and will be overseen by human guards.
- Company involved
- European Union (iBorderCtrl project)
- AI system involved
- iBorderCtrl
6 source articles · read the reporting →
Attempted deepfake CEO voicemail fraud against an unnamed technology company
An attacker used synthetic audio deepfake to leave a voicemail impersonating the CEO of a technology company, asking an employee to call back to finalize an urgent business deal. The employee found it suspicious and referred the matter to the legal department, avoiding any loss. Nisos analyzed the audio and found inconsistencies in pitch and tone.
10 source articles · read the reporting →
Europol cracks down on network using deepfake ads for crypto fraud
Europol and national authorities in Belgium, Bulgaria, Germany, and Israel arrested two people in November as part of a crackdown on a criminal network that used fraudulent online ads and AI-generated deepfake videos to lure victims into fake cryptocurrency investment platforms. The network allegedly laundered 700 million euros ($816 million) through the scheme, which Europol described as operating on an 'industrial' scale. The arrests were the second phase of an operation that had already led to nine arrests in October. The article does not name the suspects or firms targeted.
4 source articles · read the reporting →
DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts
DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.
- Company involved
- DeepScore
- AI system involved
- DeepScore
6 source articles · read the reporting →
Denmark's Udbetaling Danmark welfare algorithm illegally surveilled millions
Udbetaling Danmark (UDK), Denmark's centralized welfare payment agency, used automated algorithms to check eligibility and detect fraud. The system collected personal data on millions of beneficiaries and their relatives, including non-beneficiaries, in what a think-tank called 'systematic surveillance'. A complaint to the Danish Data Protection Authority led to a ruling that the data collection violated GDPR, and UDK eventually deleted the illegally obtained data. The system also caused erroneous payments, including underpaying 300,000 pensioners by 94 million euros annually.
- Company involved
- Udbetaling Danmark
10 source articles · read the reporting →
Face recognition bypass used to register shell companies for tax fraud in Shanghai
In a major tax fraud case in Shanghai, criminals used face recognition cracking techniques to register shell companies on government platforms. They purchased high-resolution photos and used apps to create fake videos, then used modified phones to bypass face recognition authentication. The scheme resulted in fraudulent invoices totaling over 500 million yuan. The case was prosecuted by the Shanghai procuratorate.
7 source articles · read the reporting →
AI-powered scam sent to Daniel Handford
Daniel Handford received a scam that used AI to appear more convincing. He tweeted about it to Martin Lewis, who said he had seen similar scams. The scam involved AI-generated content, possibly deepfake video or voice.
10 source articles · read the reporting →
Hong Kong police arrest six in fraud syndicate using AI deepfake for loan scams
Hong Kong police arrested six people in a crackdown on a fraud syndicate that used AI deepfake technology to create doctored images for loan scams targeting banks and money-lenders. The case marks the first known instance of scammers using deepfake to fleece financial agencies. The police reminded the public to be aware of signs of deepfakes in video calls.
9 source articles · read the reporting →
