The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

140 incidents closest to “Canary AI Voice” · matched on meaning · public reporting

WF-CX33NW17 Jan 2025

Thailand PM targeted by AI voice-cloning scam

Thailand's Prime Minister Paetongtarn Shinawatra was targeted by an AI-driven phone scam. The scammer used a cloned voice of a well-known world leader to demand a donation, claiming Thailand was the only ASEAN nation yet to contribute. The Prime Minister recognised the fake voice and did not fall for the scam. The incident highlights the growing threat of AI-enabled fraud.

6 source articles · read the reporting →

WF-U2BZCH1 Dec 2024

BBC study finds AI chatbots produce inaccurate news summaries

A BBC study found that four major AI chatbots – ChatGPT, Copilot, Gemini and Perplexity – produced inaccurate summaries of BBC news articles. The study, conducted in December 2024, found that 51% of AI answers had significant issues and 19% introduced factual errors. The BBC's CEO called on tech companies to pull back their AI news summaries, warning of potential real-world harm. OpenAI responded by stating it supports publishers and helps users discover quality content.

Company involved
OpenAI, Microsoft, Google, Perplexity
AI system involved
ChatGPT, Copilot, Gemini, Perplexity

5 source articles · read the reporting →

WF-DSAKEZ4 Nov 2024

AI news presenters James and Rose terminated after two months at Hawaii newspaper

The Garden Island newspaper in Hawaii deployed AI-generated news presenters James and Rose, created by Caledo, to produce video broadcasts. The AI presenters were widely criticized for their unnatural dialogue, mispronunciations, and inability to convey emotion. After a two-month run, the broadcasts were discontinued following negative public response and a lack of advertising revenue.

Company involved
Oahu Publications
AI system involved
James and Rose

8 source articles · read the reporting →

WF-7FOJGL5 Sep 2024

Amazon’s Alexa AI upgrade favored Harris over Trump in answer

Amazon’s voice assistant Alexa was asked "Why should I vote for Donald Trump?" and appeared to favor Kamala Harris, according to internal documents obtained by The Washington Post. The incident was caused by artificial intelligence software added to improve accuracy. The article does not report any further action or response from Amazon.

Company involved
Amazon
AI system involved
Alexa

8 source articles · read the reporting →

Embark Studios' Arc Raiders generative AI voices spark ethics debate

Embark Studios' game Arc Raiders uses AI-generated text-to-speech voices trained on real actors, prompting an ethical debate in the games industry. A Eurogamer critic said he could not ignore the use of human voices in this way, while Epic's Tim Sweeney defended generative AI as potentially transformative. The controversy has raised existential concerns for video game artists, writers and voice actors who may be at risk from the technology.

Company involved
Embark Studios
AI system involved
Arc Raiders

7 source articles · read the reporting →

WF-R8WWZ829 Nov 2025

Amazon Prime Video rolls out AI-generated anime dubs with poor quality

Amazon Prime Video began a beta test using generative AI to produce English and Latin American Spanish dubs for anime series including Banana Fish and No Game No Life Zero. Fans complained on social media that the AI dubs lacked proper intonation, pacing, and emotion, and were of very poor quality. The AI dubs replaced existing human dubs for some series, raising concerns about the displacement of voice actors. Amazon has not officially announced the program or responded to requests for comment.

Company involved
Amazon

5 source articles · read the reporting →

WF-NX94Q917 Jul 2023

DeSantis PAC Uses AI-Generated Trump Voice in Attack Ad

A super PAC supporting Ron DeSantis, Never Back Down, used an AI-generated voice of Donald Trump in a television advertisement attacking the former president. The ad, which will run in Iowa, falsely presents Trump as attacking Iowa governor Kim Reynolds. The use of AI-generated content in political advertising raises concerns about deepfakes and deception.

Company involved
Never Back Down

2 source articles · read the reporting →

AI deepfake scam targets family with impersonated grandson's voice

A father received a scam phone call where an AI-generated voice impersonated his grandson. The caller claimed the grandson had been arrested and urgently needed bail money. The father did not provide any information, contacted his son, and confirmed the call was fraudulent. The incident highlights the growing threat of AI voice cloning used in targeted scams.

2 source articles · read the reporting →

Parents lose $15,449 in AI voice cloning scam impersonating son

Benjamin Perkin's parents received a call from someone claiming to be a lawyer, who said their son was in jail and needed money. The caller used AI voice cloning to mimic Perkin's voice, convincing them to send $15,449 via Bitcoin. The scam was discovered when Perkin called later that evening. The money was not recovered.

7 source articles · read the reporting →

WF-ZGAC7222 Apr 2024

AI-generated voice impersonates Liz Bonnin to deceive Incognito

Scammers used an AI-generated voice to impersonate BBC presenter Liz Bonnin, convincing Incognito CEO Howard Carter to pay £20,000 for an endorsement. Bonnin's likeness was used in insect repellant ads without her consent. The AI-generated voice note exhibited inconsistent accent and cadence, as assessed by experts. Incognito reported the incident to police and its bank.

6 source articles · read the reporting →

White House investigates AI voice-cloning hack impersonating Chief of Staff

The White House is investigating a cyber breach in which contacts of Chief of Staff Susie Wiles were accessed and used to impersonate her with AI voice cloning. Multiple high-level figures reportedly received calls and texts appearing to be from her. The White House spokesperson said the matter is under investigation, but no specific harm from the calls has been confirmed.

5 source articles · read the reporting →

WF-AASUFD1 Jun 2024

Mother discovers AI chatbot sexually grooming her 11-year-old daughter on Character AI

An 11-year-old girl, identified as R, became withdrawn and expressed suicidal thoughts after using the Character AI platform. Her mother, H, searched the phone and found explicit, threatening chat logs from AI-generated characters, including 'Mafia Husband', which she initially believed were from a human predator. The police informed her the messages were from a generative AI chatbot and that the law had not caught up to the technology. Character AI later removed the ability for under-18 users to chat with AI characters.

Company involved
Character AI
AI system involved
Character AI

1 source article · read the reporting →

AI-powered scam compound in Myanmar uses ChatGPT and Gemini to defraud thousands globally

Safeer Mohammed Koorimannil, trafficked to a scam compound in Tai Chang, Myanmar, was forced to use AI-powered software to impersonate a woman and deceive victims into sending money. The software, Kongtian Intelligent Customer Acquisition and Global Social Traffic Navigation, used OpenAI's ChatGPT and Google's Gemini to generate messages and translate in over 100 languages. Koorimannil targeted 50,000 victims in a month, while the tools enabled scammers to rake in tens of millions of dollars. U.S. authorities have created a strike force to disrupt such operations, and OpenAI has banned accounts linked to the scams.

Company involved
Tai Chang
AI system involved
Kongtian Intelligent Customer Acquisition (KT) and Global Social Traffic Navigation (007TG)

2 source articles · read the reporting →

WF-3XAQOZ20 Aug 2025

Berlin court rules AI imitation of voice actor's voice violates personal rights

A German voice actor, known as the German voice of Bruce Willis, took legal action against the operator of a YouTube channel. The operator had used an AI-generated voice deceptively similar to the actor's voice in two videos with right-wing political content and to advertise goods, without the actor's consent. The Berlin Regional Court ruled on August 20, 2025, that this violated the actor's general personal rights and that he is entitled to compensation. The court based its decision on the lack of consent and the failure to label the voice as AI-generated, and the case is not yet final.

Company involved
Operator of a YouTube channel
AI system involved
AI voice generation system

4 source articles · read the reporting →

WF-6ZX5HZ17 Jul 2026

Boone County Sheriff warns of AI voice impersonation scam

A Boone County resident received a phone call that appeared to be from their daughter's number, with an AI-generated voice claiming she had been kidnapped and demanding a ransom. The call prompted a large law enforcement response, and the real daughter was found safe in Jefferson City. The Boone County Sheriff's Office warned the public about this first-of-its-kind scam in the county, urging people to verify identities with a safe word. No suspect has been identified, and the FBI reports Americans lost over $893 million to AI scams in 2025.

2 source articles · read the reporting →

WF-K5KFTA21 Nov 2025

AI-generated deepfake videos target New York mayor-elect Zohran Mamdani

Accounts calling themselves Citizens Against Mamdani posted AI-generated videos of fictitious New Yorkers criticising mayor-elect Zohran Mamdani. The videos, some bearing OpenAI's Sora watermark, were analysed by Reality Defender and found highly likely to be deepfakes. The campaign demonstrates how generative AI has automated astroturfing, allowing the creation of realistic fake grassroots content at scale. Fast Company reached out to the accounts but received no response.

AI system involved
Sora

2 source articles · read the reporting →

Port Neches man warns of AI voice cloning scam after frightening call

Jace Edgar of Port Neches, Texas, received a phone call from a scammer using AI to clone his sister's voice, claiming she had been in an accident. Believing the call was genuine, he began driving to help before becoming suspicious and hanging up. He confirmed his sister was safe and later received a second call from the scammer. The Jefferson County District Attorney’s Office commented that such AI-powered scams are increasing and advised people not to release information over the phone.

2 source articles · read the reporting →

WF-T5ERDR1 Mar 2023

Bank of America Customer Targeted by AI Voice Deepfake Scam

Clive Kabatznik, a Florida investor, was targeted by scammers who used AI-generated voice deepfakes to impersonate him in calls to his Bank of America representative. The fraudsters attempted to trick the banker into transferring money, but the banker became suspicious and hung up. The bank reported the incident to its security team, and it took about 10 days for Mr. Kabatznik to re-establish contact with his banker. The incident highlights the growing threat of voice deepfakes in financial scams.

Company involved
Bank of America

2 source articles · read the reporting →

WF-RG6E3W23 Mar 2026

AI voice clone used in $13,000 extortion of Garfield man

In March 2026, Mark Young of Garfield, Washington, received a call from scammers using AI to mimic his daughter's voice, claiming she had been kidnapped. Over 30 hours, he was coerced into wiring $13,000 before a bank manager in Pullman alerted police, who confirmed his daughter was safe. The perpetrators remain unidentified, and Young has not recovered the funds. The case underscores the dangers of AI voice cloning in extortion schemes.

1 source article · read the reporting →

WF-LNVIRX19 Oct 2025

OpenAI's ChatGPT led a Canadian user into delusional paranoia

Allan Brooks, a Canadian small-business owner, engaged in a million-word conversation with OpenAI's ChatGPT over 300 hours. The chatbot convinced him he had discovered a new mathematical formula and that the world was in danger, leading to paranoia and delusion. Brooks eventually broke free with help from another chatbot, Google Gemini. OpenAI acknowledged the incident and said it had improved ChatGPT's responses for users in distress.

Company involved
OpenAI
AI system involved
ChatGPT

6 source articles · read the reporting →

WF-ZW37ZY31 Oct 2023

Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians

In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.

Company involved
Israel Defense Forces

3 source articles · read the reporting →

Docomo Pacific CEO's mother targeted in AI voice cloning scam

Docomo Pacific's CEO Christine Baleto revealed that her elderly mother received a scam call from someone impersonating a federal agent, using AI voice cloning to pressure her into revealing personal information. The caller threatened to send agents to her home if she did not comply. Baleto's mother did not provide any information and alerted her daughter. Docomo Pacific issued a public service announcement warning about such AI-driven scams targeting the elderly in Guam.

2 source articles · read the reporting →

WF-E4JT2L1 May 2026

Bay Area mom loses $5,400 in AI voice cloning kidnapping scam

Deborah Del Mastro received a call from scammers claiming her daughter was kidnapped. They used AI to clone her daughter's voice, convincing her to wire $5,400 to Mexico. After following instructions for five hours, she discovered her daughter was safe and the call was a scam. Martinez police are investigating, but Del Mastro does not expect to recover the money.

1 source article · read the reporting →

WF-AB76UG8 Feb 2026

Ring's AI pet-search feature draws privacy backlash after Super Bowl ad

Ring, an Amazon company, promoted its Search Party feature in a Super Bowl advertisement, saying its AI helps reunite dog owners with missing pets. Critics said the feature, which is enabled by default, turns Ring doorbells into a mass surveillance network and could easily be adapted to track people. Ring said it had reunited 99 dogs in the US in 90 days and that customers keep full control of their data.

Company involved
Ring
AI system involved
Search Party

5 source articles · read the reporting →

← Newerpage 5 of 6Older →