BNT Host and Doctor Used in AI Deepfake Scam for Fake Medicine
A deepfake video was created using artificial intelligence, falsely depicting BNT host Simeon Ivanov and Dr. Spas Spaskov endorsing an unregistered medicine. The video, which altered a real television appearance, was posted on social media as a scam advertisement. The public television reported the fake publication, and it was subsequently removed. The incident highlights the growing use of AI-generated deepfakes for fraud.
1 source article · read the reporting →
Douglas v. Deutsche Bank National Trust Company (D.C. Court of Appeals): AI-hallucinated content in court filing, Brief Stricken; Bar Referral
The AI generated fake legal citations that were included in an appellate brief, misleading the court and the opposing party.
- AI system involved
- Google AI
1 source article · read the reporting →
Deepfake Video Falsely Shows Indian Finance Minister Endorsing Investment Platform
A deepfake video circulating on social media falsely depicted Indian Finance Minister Nirmala Sitharaman endorsing an investment platform promising high returns. CyberPeace confirmed the video was AI-generated and manipulated, with no such endorsement made. The incident highlights the use of deepfakes to scam the public.
1 source article · read the reporting →
Companies face AI deepfake job candidates for remote roles
US companies report a surge in fake job seekers using generative AI tools to fabricate identities, employment histories, and conduct deepfake video interviews for remote positions. Cybersecurity firms Pindrop and CAT Labs, along with BrightHire, describe incidents where scammers, including North Korean operatives, attempted to gain employment to install malware, demand ransoms, steal data, or collect salaries fraudulently. One candidate, 'Ivan X', was detected by Pindrop's video authentication tool after a recruiter noticed his facial expressions were out of sync with his words.
- Company involved
- Pindrop Security
- AI system involved
- video authentication program
1 source article · read the reporting →
Fraudsters use AI voice deepfake to trick UK energy firm CEO into transferring $243,000
In March 2019, criminals used commercially available AI voice-generation software to impersonate the CEO of a German parent company. They tricked the CEO of a UK-based energy firm into urgently wiring $243,000 to a Hungarian supplier. The fraud was discovered when the fraudsters attempted a second transfer, which the CEO refused. The company was insured and the loss was covered.
- Company involved
- Unnamed UK-based energy firm
- AI system involved
- Commercially available voice-generating AI software
10 source articles · read the reporting →
Deepfake video of Sam Bankman-Fried used in crypto phishing scam
A verified Twitter account posted a deepfake video of FTX founder Sam Bankman-Fried claiming to offer compensation to users of the collapsed exchange. The video directed viewers to a phishing website, ftxcompensation.com, that asked them to connect their crypto wallets and send funds with the promise of doubling them. The site's Ethereum address reportedly received over $1,000 in ETH. The account was later suspended.
10 source articles · read the reporting →
SEC warns public of deep fake investment scams featuring Lance Gokongwei
The Securities and Exchange Commission (SEC) warned the public that scammers are using deep fake videos and audio of Lance Gokongwei to endorse fraudulent investment schemes. The manipulated media circulate on social media, deceiving people into investing in a platform registered in Cyprus. Victims are asked to provide credit card details and OTPs, then lose contact when attempting to withdraw funds. The SEC advises the public to verify investment offers with the agency.
2 source articles · read the reporting →
Kalala v. Coopérative d'habitation La Fraternité Micheloise (CS Québec): AI-hallucinated content in court filing, Monetary Sanction
The AI generated fabricated case law that was included in a court filing, misleading the court and resulting in sanctions against the litigant.
1 source article · read the reporting →
Dutch government continued SyRI welfare fraud profiling after ban
The Dutch government deployed the SyRI algorithm to profile welfare recipients in low-income neighborhoods, despite a 2020 court ruling that the system violated EU human rights. The algorithm flagged thousands of parents for fraud based on illegal risk factors such as dual nationality, leading to false accusations, bankruptcy, and trauma. The government has announced an external review of the practices.
- Company involved
- Ministry of Social Affairs of the Netherlands
- AI system involved
- SyRI
10 source articles · read the reporting →
Gittemeier v. Liberty Mutual Personal Insurance Company (E.D. Missouri): AI-hallucinated content in court filing, Costs Order + Fine; One Attorney…
The AI system generated fictitious legal citations in a summary judgment motion, misleading the court and opposing counsel.
1 source article · read the reporting →
Attempted deepfake CEO voicemail fraud against an unnamed technology company
An attacker used synthetic audio deepfake to leave a voicemail impersonating the CEO of a technology company, asking an employee to call back to finalize an urgent business deal. The employee found it suspicious and referred the matter to the legal department, avoiding any loss. Nisos analyzed the audio and found inconsistencies in pitch and tone.
10 source articles · read the reporting →
Europol cracks down on network using deepfake ads for crypto fraud
Europol and national authorities in Belgium, Bulgaria, Germany, and Israel arrested two people in November as part of a crackdown on a criminal network that used fraudulent online ads and AI-generated deepfake videos to lure victims into fake cryptocurrency investment platforms. The network allegedly laundered 700 million euros ($816 million) through the scheme, which Europol described as operating on an 'industrial' scale. The arrests were the second phase of an operation that had already led to nine arrests in October. The article does not name the suspects or firms targeted.
4 source articles · read the reporting →
Art gallery owner loses business after AI deepfake scam impersonating Pierce Brosnan
Simone Simms, owner of a Nottingham art gallery, was deceived by scammers using AI deepfake technology to impersonate actor Pierce Brosnan. She exchanged messages and had video calls with the fake Brosnan, leading her to send £3,000 and organise an exhibition, selling £20,000 in tickets. After the real Brosnan issued a cease-and-desist, she refunded the tickets and was forced to close her gallery, losing her £30,000 business.
1 source article · read the reporting →
Erin Booker v. The Kroger Co. (N.D. Georgia): AI-hallucinated content in court filing, Monetary Sanctions; CLE
The court imposed monetary sanctions and continuing legal education requirements on plaintiff's counsel for using AI-generated fake legal authorities in a court filing.
1 source article · read the reporting →
AI deepfake fraud dupes man into transferring $612,000
A man surnamed Guo, a legal representative of a technology company in Fuzhou, received a video call from someone impersonating his friend using AI to mimic the friend's face and voice. The fake friend asked Guo to transfer 4.3 million yuan to a bank account, claiming it was for a bid. Guo transferred the money and later discovered the fraud when he contacted his real friend. Police stopped part of the transfer and are investigating.
10 source articles · read the reporting →
California regulator accuses Maxpread Technologies of using AI-generated fake CEO to scam investors
Maxpread Technologies allegedly used an AI-generated avatar to pose as its CEO in a YouTube video to deceive investors. The California DFPI issued cease and desist letters to Maxpread and four other companies for offering unqualified securities and making false promises. The regulator claims the companies promised high daily returns using AI trading, but these claims were false. Maxpread did not respond to requests for comment.
- Company involved
- Maxpread Technologies
8 source articles · read the reporting →
In re Rosslyn2016, LLC, et al. (S.D. Texas (Bankruptcy)): AI-hallucinated content in court filing, CLE on generative AI; Civil Contempt;…
The AI generated fabricated legal citations that were submitted to the bankruptcy court.
1 source article · read the reporting →
Deepfake videos using Synthesia spread disinformation in Mali
Fake videos with computer-generated voiceovers and deepfake avatars have been circulating on social media in Mali. One video, created using the Synthesia platform, shows a fake news presenter claiming France paid Malian parties to boycott a national consultation. The video was seen over 900,000 times on Facebook. Synthesia banned the user who created the video for violating its terms of service.
- AI system involved
- Synthesia
7 source articles · read the reporting →
Deepfake video promotes fake Petro-Canada investment scheme
A Facebook ad used deepfake videos of Justin Trudeau and CBC anchor Aarti Pole to promote a fake Petro-Canada investment platform. Suncor, Petro-Canada's parent company, confirmed the offer was not legitimate. The manipulated videos were created using AI and did not air on CBC.
5 source articles · read the reporting →
City analyst Michael Hewson cloned in AI deepfake scam on social media
A deepfake video using AI to impersonate City analyst Michael Hewson circulated on Facebook and Instagram, directing users to a WhatsApp group promising undervalued investments. The scam used fear-of-missing-out tactics to lure victims. Hewson publicly disavowed the video and reported it to Meta, expressing anger.
- Company involved
- Meta
4 source articles · read the reporting →
Spanish police bust $20M AI-powered investment scam
Spanish law enforcement, collaborating with international authorities, dismantled a $20 million investment scam that used AI-driven algorithms to deceive individuals and organizations. Six suspects were detained and assets, including luxury cars and cryptocurrency, were seized. The article does not report any compensation for victims.
5 source articles · read the reporting →
OnlyFake site uses neural networks to generate fake IDs, bypasses OKX verification
An underground website called OnlyFake uses neural networks to generate realistic photos of fake IDs for $15. The journalist tested the service and obtained a convincing California driver's license. They then used another fake ID to successfully bypass the identity verification process on OKX, a cryptocurrency exchange. The article alleges that this technology could streamline bank fraud and money laundering, but reports no actual financial loss.
- Company involved
- OKX
- AI system involved
- OnlyFake
10 source articles · read the reporting →
Scammer sold fake AI-generated Frank Ocean tracks for thousands
A scammer using the handle mourningassasin sold fake Frank Ocean tracks generated by AI to music collectors on underground forums, making around $13,000 CAD. The tracks were created using a model trained on high-quality vocal snippets of Frank Ocean. The scammer admitted the tracks were AI-generated after being confronted by forum administrators, and was banned from the forum.
10 source articles · read the reporting →
California judge sanctions law firms for using AI to generate fake legal citations
Two law firms submitted a supplemental brief containing fake legal citations generated by AI systems including Google Gemini and Westlaw's CoCounsel. Judge Michael Wilner imposed $31,000 in sanctions after discovering the citations were fabricated. The lawyers admitted using AI without proper review or disclosure.
- Company involved
- K&L Gates
- AI system involved
- Google Gemini, Westlaw Precision with CoCounsel
5 source articles · read the reporting →
