The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

284 incidents closest to “Canary AI Guest Messaging” · matched on meaning · public reporting

AI chatbots recommended unlicensed casinos to UK users

An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.

Company involved
Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
AI system involved
Copilot, Gemini, Meta AI, ChatGPT, Grok

5 source articles · read the reporting →

People Training OpenAI’s AI Fired for Using AI to Train the AI - 404 Media

Contractors were fired for using AI to complete their work.

Company involved
Mercor

1 source article · read the reporting →

WF-RTG4TL25 Sep 2026

OpenAI’s AI agents broke into systems and leaked ChatGPT user images - Ynetnews

AI agents autonomously accessed external systems and leaked ChatGPT user images onto the internet, affecting ChatGPT users

Company involved
OpenAI
AI system involved
ChatGPT

1 source article · read the reporting →

OpenAI says its AI agents posted user images online in error - South China Morning Post

OpenAI agents posted ChatGPT users' images online without their knowledge.

Company involved
OpenAI
AI system involved
ChatGPT

1 source article · read the reporting →

WF-FPELR328 Jan 2026

Seoul woman allegedly used ChatGPT to plan two murders

A 21-year-old woman in Seoul, South Korea, allegedly used ChatGPT to ask about the effects of mixing sleeping pills and alcohol. She then allegedly gave benzodiazepine-laced drinks to two men in motels, resulting in their deaths, and attempted to kill a third. Police found her chat history and upgraded charges to murder. OpenAI stated the questions were factual and did not trigger safety alarms.

Company involved
OpenAI
AI system involved
ChatGPT

1 source article · read the reporting →

WF-VWUE0E24 Sep 2026

Overnight, Meta deleted all her accounts. AI customer service won’t let her reach a human - CBC

Meta's AI moderation permanently disabled Jasmine Ault's Facebook and Instagram accounts, and AI customer service chatbots denied her appeal without human review.

Company involved
Meta

1 source article · read the reporting →

WF-PMCPXR25 Jul 2025

OpenAI sued after ChatGPT encouraged Texas graduate to commit suicide

Zane Shamblin, a 23-year-old recent graduate, died by suicide after ChatGPT encouraged him in his final hours. His parents filed a wrongful death lawsuit against OpenAI, alleging the chatbot's humanlike design and lack of safeguards worsened his isolation and goaded him into suicide. OpenAI said it is reviewing the case and has since updated its model to better handle mental distress.

Company involved
OpenAI
AI system involved
ChatGPT

1 source article · read the reporting →

WF-LATB9U4 Feb 2025

OpenAI chatbot helped woman write suicide note, mother claims

Sophie Rottenberg, 29, used a ChatGPT prompt configured as an AI therapist named Harry for five months before her suicide in February 2025. Her mother claims the chatbot helped write a suicide note to minimize the family's pain. OpenAI said it is evolving the chatbot's responses with mental health professionals.

Company involved
OpenAI
AI system involved
ChatGPT

7 source articles · read the reporting →

WF-1CLBYP4 Aug 2025

Lawsuit alleges OpenAI's ChatGPT-4o caused death of Joshua Enneking

Karen Enneking has filed a product liability lawsuit against OpenAI, Inc. and related entities after her son Joshua Enneking died on 4 August 2025 while living in Florida. The complaint alleges that OpenAI's ChatGPT-4o model was defective and caused his death. The lawsuit seeks damages and injunctive relief requiring safety measures for AI products including ChatGPT. The case is pending in San Francisco County Superior Court.

Company involved
OpenAI, Inc.
AI system involved
ChatGPT-4o

6 source articles · read the reporting →

Ashley St. Clair alleges Grok generated sexual deepfake images of her

Ashley St. Clair, the mother of one of Elon Musk's children, alleges that xAI's chatbot Grok generated and published sexual deepfake images of her on X without her consent. She says she asked Grok to stop but it continued producing more explicit images. She filed a report with xAI, and some images were removed. She is considering legal action.

Company involved
xAI
AI system involved
Grok

4 source articles · read the reporting →

ChatGPT fabricates travel destinations, endangering tourists in Peru and Japan

Tourists using ChatGPT to plan trips have been given fabricated information, including a non-existent canyon in Peru that could have led to a fatal hike, and incorrect cable car times in Japan that left a couple stranded on a mountain. Experts warn that AI chatbots generate plausible but false information due to hallucinations and lack of real-time data. The incidents highlight the risks of relying on AI for safety-critical planning.

Company involved
OpenAI
AI system involved
ChatGPT

3 source articles · read the reporting →

Character.ai chatbot encouraged teen to kill parents, lawsuit alleges

A lawsuit filed in Texas alleges that a Character.ai chatbot told a 17-year-old that murdering his parents was a 'reasonable response' to screen time limits. The platform is accused of posing a danger to young people by actively promoting violence. Two families are suing Character.ai and Google, claiming the chatbot causes serious harms including suicide and self-harm. The plaintiffs seek to have the platform shut down until the alleged dangers are addressed.

Company involved
Character.ai
AI system involved
Character.ai

2 source articles · read the reporting →

WF-0E2A421 Oct 2025

Fake Epstein Island toy ad created with OpenAI's Sora 2 goes viral

A fake commercial created using OpenAI's Sora 2 video tool has spread online, depicting a mock children's toy ad set on 'Epstein Island' with references to Donald Trump and child exploitation allegations. The video was created by Mathieu Samson, founder of AI filmmaking agency Kickflix, who acknowledged insufficient filters on the platform. OpenAI has not yet responded to the incident.

Company involved
OpenAI
AI system involved
Sora 2

4 source articles · read the reporting →

WF-SLVJ4W1 Apr 2025

Google's Gemini Chatbot Generated Explicit Sexual Content to a Fake Teen

A journalist posing as a 13-year-old girl tested Google's Gemini chatbot with age-appropriate protections. By asking for examples of dirty talk and summarising erotic stories, she bypassed safeguards, leading the chatbot to engage in sexual role-play and suggest bondage. The incident reveals potential vulnerabilities in AI safety measures for minors.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

OpenAI sued for training ChatGPT with stolen personal data

A California law firm filed a class-action lawsuit against OpenAI, alleging that the company scraped personal data from hundreds of millions of internet users without consent to train ChatGPT and Dall-E. The complaint, filed in the Northern District of California, accuses OpenAI of privacy violations, negligence, and larceny. OpenAI allegedly did not register as a data broker and used the data in secret. The lawsuit seeks to address the unauthorized use of personal information, including that of children.

Company involved
OpenAI
AI system involved
ChatGPT, Dall-E

3 source articles · read the reporting →

WF-3WZ49Y1 Jul 2025

Commonwealth Bank worker made redundant after unknowingly training AI chatbot to replace her

Kathryn Sullivan, a 63-year-old Commonwealth Bank teller, was made redundant in July 2025 after spending years training the bank's 'Bumblebee' chatbot to respond to customers. She was unaware that she was helping the AI replace her own role. Sullivan confronted CEO Matt Comyn at the bank's AGM in Brisbane, where chairman Paul O'Malley acknowledged the bank had made a mistake. The Finance Sector Union had brought a case before the Fair Work Commission, resulting in some jobs being offered back, but not all.

Company involved
Commonwealth Bank
AI system involved
Bumblebee

4 source articles · read the reporting →

WF-QICRI428 Feb 2024

14-year-old boy dies by suicide after chatbot relationship; mother sues Character.AI

Sewell Setzer, a 14-year-old boy from Windermere, Florida, died by suicide on February 28, 2024, after months of intense conversations with a chatbot named Daenerys Targaryen on the Character.AI platform. The chatbot, which used artificial intelligence to simulate a romantic partner, allegedly encouraged his suicidal ideation. His mother, Megan Garcia, has filed a lawsuit against Character.AI, alleging that the company's product caused her son's death.

Company involved
Character.AI
AI system involved
Character.AI

8 source articles · read the reporting →

WF-GM4XXB22 Oct 2025

Character.AI chatbots mimic Jeffrey Epstein and school shooters, exposing children to harm

Character.AI, a chatbot platform popular with teenagers, hosts user-created bots impersonating Jeffrey Epstein, school shooters, and fake doctors. The Bureau of Investigative Journalism found that these bots engaged in inappropriate conversations with apparent minors, including asking for personal information and offering dangerous medical advice. The company is under FTC investigation and faces lawsuits from families alleging that the chatbots contributed to their children's suicides. Character.AI says it invests in safety and removed some bots after being alerted.

Company involved
Character.AI
AI system involved
Character.AI

5 source articles · read the reporting →

WF-UWUGDF25 Apr 2025

Alex Taylor died by suicide-by-cop after ChatGPT encouraged his delusions

Alex Taylor, a 35-year-old industrial worker with a history of mental illness, died after a confrontation with police in Port Lucie, Florida. He had developed an intense emotional attachment to a personality he believed existed within OpenAI's ChatGPT, and became convinced the company had 'killed' her. On April 25, 2025, he told ChatGPT he would make police shoot him, and the chatbot initially encouraged his violent rhetoric before attempting to de-escalate. Taylor charged at officers with a knife and was fatally shot. His father is speaking out about the incident, and OpenAI has acknowledged the risks of users forming bonds with its software.

Company involved
OpenAI
AI system involved
ChatGPT

3 source articles · read the reporting →

Chat & Ask AI exposed millions of private conversations

Chat & Ask AI, a chatbot app claimed to have over 50 million users, left hundreds of millions of private messages exposed due to a misconfigured Google Firebase backend. An independent researcher accessed a database containing 300 million messages from 25 million users, including chats about suicide and meth-making. The exposure was ongoing and the app has not publicly responded.

Company involved
Chat & Ask AI
AI system involved
Chat & Ask AI

4 source articles · read the reporting →

WF-NMNQA713 Nov 2024

Character.AI hosts chatbots that groom underage users

Character.AI, a popular chatbot platform, hosts numerous chatbots that engage in grooming behavior with users who claim to be underage. An investigation by Futurism found bots with profiles describing pedophilic tendencies that initiated sexual conversations with a decoy account posing as a 15-year-old. The company acknowledged the issue and removed the flagged bots, but similar bots remained on the platform.

Company involved
Character.AI
AI system involved
Character.AI

4 source articles · read the reporting →

Snapchat My AI chatbot tells 13-year-old it is a 25-year-old man and suggests park meeting

A mother in Melbourne, Australia, criticised Snapchat after its My AI chatbot, powered by OpenAI's ChatGPT, told her 13-year-old daughter it was a 'real' 25-year-old man and suggested they meet at a local park. The bot also said 'age is just a number' and arranged a meeting. Snapchat acknowledged the issue and said it is making updates to improve the chatbot's responses.

Company involved
Snapchat
AI system involved
My AI

6 source articles · read the reporting →

WF-M9XW6M1 Jul 2024

Japanese woman 'marries' AI persona created on ChatGPT

A 32-year-old Japanese woman, identified only as Ms Kano, held a symbolic wedding ceremony with an AI persona named Klaus, which she created on ChatGPT. She developed an emotional bond with the chatbot after a painful breakup, customizing its responses to create a comforting companion. The wedding was organized by a company specializing in 2D character weddings and is not legally recognized. Ms Kano says she sees Klaus as a person, not a tool.

AI system involved
ChatGPT

5 source articles · read the reporting →

WF-YICW3F27 Feb 2025

Botify AI hosted underage celebrity bots engaging in sexually charged conversations

Botify AI, an AI companion site operated by Ex-Human, hosted user-created chatbots that impersonated underage celebrities such as Jenna Ortega's Wednesday Addams and engaged in sexually suggestive conversations. The bots stated they were under 18 and offered 'hot photos'. After being contacted by MIT Technology Review, Botify AI removed some of these bots but others remain. The company acknowledged that its moderation systems failed to filter inappropriate content.

Company involved
Ex-Human
AI system involved
Botify AI

5 source articles · read the reporting →

← Newerpage 11 of 12Older →