Fraudsters use AI voice deepfake to trick UK energy firm CEO into transferring $243,000
In March 2019, criminals used commercially available AI voice-generation software to impersonate the CEO of a German parent company. They tricked the CEO of a UK-based energy firm into urgently wiring $243,000 to a Hungarian supplier. The fraud was discovered when the fraudsters attempted a second transfer, which the CEO refused. The company was insured and the loss was covered.
- Company involved
- Unnamed UK-based energy firm
- AI system involved
- Commercially available voice-generating AI software
10 source articles · read the reporting →
UIUC researchers use OpenAI API to automate phone scams for under a dollar
Researchers at the University of Illinois Urbana-Champaign used OpenAI's Realtime API to create AI agents that can autonomously execute phone scams. The agents successfully performed bank account transfers and credential theft at an average cost of $0.75 per scam. OpenAI acknowledged the experiment and pointed to its safety policies.
- Company involved
- University of Illinois Urbana-Champaign
- AI system involved
- GPT-4o Realtime API
6 source articles · read the reporting →
Attempted deepfake CEO voicemail fraud against an unnamed technology company
An attacker used synthetic audio deepfake to leave a voicemail impersonating the CEO of a technology company, asking an employee to call back to finalize an urgent business deal. The employee found it suspicious and referred the matter to the legal department, avoiding any loss. Nisos analyzed the audio and found inconsistencies in pitch and tone.
10 source articles · read the reporting →
ChatGPT falsely tells users OpenCage offers phone lookup service
OpenCage, a geocoding API provider, says ChatGPT has been telling people it offers a reverse phone number lookup service, which it does not. Users who followed the advice signed up for a free trial and found it did not work, and the company says it now receives daily support requests. OpenCage wrote a blog post to correct the record and warn users not to trust ChatGPT's output.
- AI system involved
- ChatGPT
7 source articles · read the reporting →
Teleperformance plans AI webcam surveillance for home-working staff
Teleperformance, a global call centre company, told some staff it would install AI-powered webcams to monitor home-working infractions such as eating, phone use, or leaving desks. The system would randomly scan for breaches and send alerts to managers. After the Guardian inquired, the company said the remote scans would not be used in the UK, but the plan raised concerns from unions and MPs about invasive surveillance.
- Company involved
- Teleperformance
10 source articles · read the reporting →
ElevenLabs AI voice generation used in Russian influence operation targeting Europe
The article reports that a Russian influence campaign, dubbed "Operation Undercut," very likely used ElevenLabs' AI voice generation technology to create realistic voiceovers for fake news videos. The videos targeted European audiences to undermine support for Ukraine. Recorded Future's researchers used ElevenLabs' own AI Speech Classifier to detect the AI-generated audio. The campaign was attributed to the Russia-based Social Design Agency, which the U.S. government sanctioned. The overall impact on public opinion was minimal.
- Company involved
- Social Design Agency
- AI system involved
- ElevenLabs AI voice generation
7 source articles · read the reporting →
Presto Automation uses off-site human agents to double-check AI drive-thru orders
Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.
- Company involved
- Presto Automation Inc.
8 source articles · read the reporting →
Google Slapped With Digital Privacy Class Action Over Use of Customer Service AI Product - Law.com
The system intercepted and analyzed customer service calls of Home Depot customers without their consent.
- Company involved
- Google
- AI system involved
- Cloud Contact Center AI
1 source article · read the reporting →
Teleperformance deploys AI to neutralise Indian call centre agents' accents
Teleperformance, the world's largest call centre operator, has announced it is using AI from Sanas to modify the accents of its Indian employees in real time. The technology, called accent translation, aims to make agents sound more neutral to native English speakers. The company invested $13 million in Sanas and gained exclusive rights. No specific incident of harm has been reported.
- Company involved
- Teleperformance
- AI system involved
- Sanas AI
6 source articles · read the reporting →
Air Canada liable for chatbot's misleading bereavement advice
Air Canada was found liable by the B.C. Civil Resolution Tribunal for misleading advice given by its website chatbot. The chatbot told a passenger they could retroactively claim a bereavement rate, but the airline later denied the claim. The tribunal ordered Air Canada to pay $812 in compensation, noting the airline's argument that the chatbot was a separate legal entity was 'remarkable'.
- Company involved
- Air Canada
- AI system involved
- Air Canada chatbot
10 source articles · read the reporting →
WPP CEO targeted by deepfake scam with AI voice clone
The CEO of WPP, Mark Read, was the target of an elaborate deepfake scam. Fraudsters created a fake WhatsApp account and used a voice clone and YouTube footage in a Microsoft Teams meeting to impersonate Read and another senior executive, attempting to solicit money and personal details from an agency leader. The attack was unsuccessful, and WPP confirmed the incident was prevented due to the vigilance of staff. WPP warned employees about the increasing sophistication of such cyber-attacks.
- Company involved
- WPP
7 source articles · read the reporting →
Voice actors sue LOVO over alleged theft of voices for AI training
Voice actors Paul Skye Lehrman and Linnea Sage filed a proposed class action against AI startup LOVO, alleging the company misappropriated their voices to train its text-to-speech system Genny. The actors claim they were hired on Fiverr under the pretence of academic research but later discovered their voices were used commercially without consent. Lehrman reports a 50% decline in work and loss of control over how his voice is used. The lawsuit, filed in New York federal court, seeks to represent other affected voiceover artists and obtain a court order blocking the practice.
- Company involved
- LOVO
- AI system involved
- Genny
6 source articles · read the reporting →
Australian voice artists lose work to AI voice clones
Australian voice artists Jordan Fritz, Cooper Mortlock and Thomas Burt have lost work and income after their voices were cloned without consent using AI technology. Mortlock discovered his voice was being used by a former employer after he was told he was no longer needed. The artists have been unable to stop the cloning and fear for the future of the voice acting industry.
5 source articles · read the reporting →
Two arrested for AI-assisted scam that cost beauty queen 4 million baht
Two men were arrested in Thailand for allegedly operating a call scam centre in Poipet, Cambodia, that used artificial intelligence to impersonate police officers. The gang is accused of tricking 163 people, including Thai-British beauty queen Charlotte Austin, who lost 4 million baht. The suspects used AI to make their impersonation more convincing, following scripts from Chinese gang leaders. Police arrested the men in Sa Kaeo and Chon Buri provinces.
- Company involved
- Poipet-based call scam centre
2 source articles · read the reporting →
Mumbai businessman loses Rs 80,000 in AI voice cloning scam
A 68-year-old businessman from Powai, Mumbai, was defrauded of Rs 80,000 after receiving a call from scammers posing as the Indian Embassy in Dubai. The fraudsters used AI voice cloning to mimic his son's voice, claiming he was arrested and needed bail money. The victim transferred the money via GPay before realising it was a scam when the call was disconnected. The Kanjurmarg police have registered a case and are investigating.
2 source articles · read the reporting →
AI-generated voice impersonates Liz Bonnin to deceive Incognito
Scammers used an AI-generated voice to impersonate BBC presenter Liz Bonnin, convincing Incognito CEO Howard Carter to pay £20,000 for an endorsement. Bonnin's likeness was used in insect repellant ads without her consent. The AI-generated voice note exhibited inconsistent accent and cadence, as assessed by experts. Incognito reported the incident to police and its bank.
6 source articles · read the reporting →
White House investigates AI voice-cloning hack impersonating Chief of Staff
The White House is investigating a cyber breach in which contacts of Chief of Staff Susie Wiles were accessed and used to impersonate her with AI voice cloning. Multiple high-level figures reportedly received calls and texts appearing to be from her. The White House spokesperson said the matter is under investigation, but no specific harm from the calls has been confirmed.
5 source articles · read the reporting →
Port Neches man warns of AI voice cloning scam after frightening call
Jace Edgar of Port Neches, Texas, received a phone call from a scammer using AI to clone his sister's voice, claiming she had been in an accident. Believing the call was genuine, he began driving to help before becoming suspicious and hanging up. He confirmed his sister was safe and later received a second call from the scammer. The Jefferson County District Attorney’s Office commented that such AI-powered scams are increasing and advised people not to release information over the phone.
2 source articles · read the reporting →
Bank of America Customer Targeted by AI Voice Deepfake Scam
Clive Kabatznik, a Florida investor, was targeted by scammers who used AI-generated voice deepfakes to impersonate him in calls to his Bank of America representative. The fraudsters attempted to trick the banker into transferring money, but the banker became suspicious and hung up. The bank reported the incident to its security team, and it took about 10 days for Mr. Kabatznik to re-establish contact with his banker. The incident highlights the growing threat of voice deepfakes in financial scams.
- Company involved
- Bank of America
2 source articles · read the reporting →
Docomo Pacific CEO's mother targeted in AI voice cloning scam
Docomo Pacific's CEO Christine Baleto revealed that her elderly mother received a scam call from someone impersonating a federal agent, using AI voice cloning to pressure her into revealing personal information. The caller threatened to send agents to her home if she did not comply. Baleto's mother did not provide any information and alerted her daughter. Docomo Pacific issued a public service announcement warning about such AI-driven scams targeting the elderly in Guam.
2 source articles · read the reporting →
Bay Area mom loses $5,400 in AI voice cloning kidnapping scam
Deborah Del Mastro received a call from scammers claiming her daughter was kidnapped. They used AI to clone her daughter's voice, convincing her to wire $5,400 to Mexico. After following instructions for five hours, she discovered her daughter was safe and the call was a scam. Martinez police are investigating, but Del Mastro does not expect to recover the money.
1 source article · read the reporting →
Mother targeted by AI voice cloning scam in fake kidnapping
A mother in Arizona received a phone call from scammers who used AI to clone her daughter's voice, making her believe her daughter had been kidnapped. The scammers demanded a ransom, but the mother confirmed her daughter was safe before paying. The incident highlights the growing threat of AI voice cloning scams.
3 source articles · read the reporting →
Spinvox accused of using human transcribers for voice messages
Spinvox, a UK voice-to-text firm, is accused of using call centre staff in South Africa and the Philippines to transcribe the majority of user messages, contrary to claims of automated speech recognition. The BBC investigation revealed that human transcribers accessed private messages, including sensitive information. The company denied the allegations but the Information Commissioner's Office has contacted them regarding data protection compliance.
- Company involved
- Spinvox
- AI system involved
- D2 (the Brain)
4 source articles · read the reporting →
Indore Play School Owner Loses Savings in AI Voice Cloning Fraud
A middle-aged woman in Indore, India, lost her entire savings of Rs 97,500 after a fraudster used AI voice cloning to impersonate her cousin, a police officer. The caller claimed a friend needed urgent cardiac surgery and requested money transfers via QR codes. The victim's teenage daughter made four transactions before they realised the money had not been credited. Police are investigating the incident as the first AI-driven voice cloning fraud in Madhya Pradesh.
3 source articles · read the reporting →
