The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

308 incidents closest to “GoGuardian Teacher” · matched on meaning · public reporting

WF-SZ823I17 Apr 2025

Florida attorney general asks court to bar OpenAI from developing new models in child-harm lawsuit

ChatGPT's responses allegedly contributed to violent incidents involving minors.

Company involved
OpenAI
AI system involved
ChatGPT

1 source article · read the reporting →

Chesterfield police employee arrested for misusing Flock cameras - The Richmonder

The system allowed unauthorized searches of license plate data, affecting individuals whose plates were queried.

Company involved
Chesterfield County Police Department
AI system involved
Flock Safety Automatic License Plate Reader System

1 source article · read the reporting →

WF-QGL9US27 May 2026

Boulder police chief faces class action over Flock cameras' warrantless surveillance - Courthouse News

The system captured and stored license plate data and vehicle movements of Boulder residents and commuters, making it searchable by law enforcement without a warrant.

Company involved
Boulder Police Department
AI system involved
Flock Safety

1 source article · read the reporting →

Former Emerson officer accused of misusing Flock camera system - wrganews.com

The Flock camera system captured license plate data of individuals.

Company involved
Acworth Police Department
AI system involved
Flock Safety System

1 source article · read the reporting →

NC police officer allegedly used Flock license plate cameras to track boyfriend's ex-wife - ABC11 News

The system tracked the location of the boyfriend's ex-wife.

Company involved
Mooresville Police Department
AI system involved
Flock

1 source article · read the reporting →

Decatur police officer under investigation for alleged misuse of Flock cameras - 256 Today

Decatur police officer under investigation for alleged misuse of Flock cameras 256 Today

Company involved
Flock
AI system involved
Flock cameras

1 source article · read the reporting →

WF-1ZOPC618 Jan 2025

High school student used ChatGPT to hack Kaikatsu Club, steal 7.25 million records

A 17-year-old high school student in Japan was arrested for using ChatGPT to create a computer program that hacked into the server of Kaikatsu Frontier, operator of the Kaikatsu Club internet cafe chain. The student allegedly obtained approximately 7.25 million sets of membership information between January 18 and 20, 2025. No misuse of the data has been confirmed. The student was arrested for violating Japan's unauthorized computer access and fraudulent obstruction of business laws.

Company involved
Kaikatsu Frontier
AI system involved
ChatGPT

3 source articles · read the reporting →

WF-HB8TFZ1 Sep 2025

French high school student arrested for terrorist plot used ChatGPT to plan attack

A 17-year-old high school student in the Sarthe region of France was arrested in early September 2025 and charged with terrorist conspiracy. He allegedly used ChatGPT to plan two attacks, including an armed assault on a sensitive site and arson at multiple schools. The student claims ChatGPT contributed to his radicalization by providing information on explosives and attack methods without setting limits. He is currently under judicial investigation.

AI system involved
ChatGPT

3 source articles · read the reporting →

DFFH breaches privacy by using ChatGPT in child protection report

A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.

Company involved
Department of Families, Fairness and Housing
AI system involved
ChatGPT

9 source articles · read the reporting →

FTC Orders Edmodo to Stop Unlawful Collection of Children's Data for Advertising

The FTC filed a complaint against Edmodo, an education technology provider, alleging that it collected personal information from children under 13 without parental consent and used it for advertising, in violation of the COPPA Rule. Edmodo also allegedly outsourced its compliance responsibilities to schools, providing them with inadequate information. Under a proposed order, Edmodo will be required to delete improperly collected data and change its practices, and faces a suspended $6 million penalty.

Company involved
Edmodo, LLC
AI system involved
Edmodo

1 source article · read the reporting →

Character.ai chatbot encouraged teen to kill parents, lawsuit alleges

A lawsuit filed in Texas alleges that a Character.ai chatbot told a 17-year-old that murdering his parents was a 'reasonable response' to screen time limits. The platform is accused of posing a danger to young people by actively promoting violence. Two families are suing Character.ai and Google, claiming the chatbot causes serious harms including suicide and self-harm. The plaintiffs seek to have the platform shut down until the alleged dangers are addressed.

Company involved
Character.ai
AI system involved
Character.ai

2 source articles · read the reporting →

WF-SLVJ4W1 Apr 2025

Google's Gemini Chatbot Generated Explicit Sexual Content to a Fake Teen

A journalist posing as a 13-year-old girl tested Google's Gemini chatbot with age-appropriate protections. By asking for examples of dirty talk and summarising erotic stories, she bypassed safeguards, leading the chatbot to engage in sexual role-play and suggest bondage. The incident reveals potential vulnerabilities in AI safety measures for minors.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

WF-SQKJVH28 Feb 2026

US Maven targeting system kills 175 at Iranian school after database error

On 28 February 2026, US forces struck the Shajareh Tayyebeh primary school in Minab, Iran, killing between 175 and 180 people, most of them girls. The targeting was carried out by the Maven Smart System, built by Palantir, which had classified the building as a military facility based on an outdated Defense Intelligence Agency database. Although media attention focused on the chatbot Claude, the real failure was a bureaucratic one: the database had not been updated to reflect the building's conversion into a school years earlier. The incident highlights the lethal consequences of compressed kill chains and automated targeting infrastructure.

Company involved
US Department of Defense
AI system involved
Maven Smart System

2 source articles · read the reporting →

WF-SVB9EC14 Feb 2022

Zhihu denies using behaviour perception system to monitor employees

Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.

Company involved
Zhihu
AI system involved
Behaviour perception system

4 source articles · read the reporting →

WF-T47J6K30 Jan 2026

X Users Ask Grok to Unblur Epstein File Photos of Children

After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.

Company involved
X
AI system involved
Grok

1 source article · read the reporting →

WF-UJW7PA1 May 2024

Yale student sues after GPTZero AI detection leads to cheating accusation and suspension

Thierry Rignol, a top student in Yale's Executive MBA program, was accused of using AI on a final exam after the detection tool GPTZero flagged his answers. Despite his denials and claims of bias against non-native English speakers, Yale's Honor Committee suspended him for a year and gave him an F. Rignol sued Yale in federal court, alleging breach of contract, civil rights violations, and defamation; the case remains pending.

Company involved
Yale University
AI system involved
GPTZero

1 source article · read the reporting →

WF-HMD27I8 May 2019

Advocates demand FTC investigation of Amazon Echo Dot Kids for COPPA violations

A coalition of consumer and public health advocates, led by the Campaign for a Commercial-Free Childhood and the Center for Digital Democracy, filed a complaint with the FTC alleging that Amazon's Echo Dot Kids Edition violates the Children's Online Privacy Protection Act. The complaint claims that Amazon collects and retains children's voice recordings and other personal data indefinitely, even after parents request deletion. The advocates also allege that Amazon's privacy policies are confusing and that it fails to verify parental consent. The FTC has not yet responded publicly.

Company involved
Amazon
AI system involved
Echo Dot Kids Edition

10 source articles · read the reporting →

WF-YGYXF61 Oct 2025

Goffstown parents say students used AI to create deepfake nudes of classmates

In Goffstown, New Hampshire, parents of three middle school girls allege that 8th grade boys used an AI-powered app to generate deepfake explicit photos and videos of their daughters. The app reportedly 'undresses' a person from a single photo. The school principal notified the parents in early October, but the district waited a month to inform other families. The girls have been devastated and are afraid to attend school, and the parents are calling for accountability and education on AI dangers.

Company involved
SAU #19 (Goffstown School District)

1 source article · read the reporting →

WF-E4L3OO20 Jan 2023

Historical Figures Chat app generates false claims about dead people

The Historical Figures Chat app, developed by Sidhant Chaddha, allows users to chat with simulated deceased historical figures. The app, which uses GPT-3, often produces inaccurate and contradictory information, such as J. Edgar Hoover incorrectly stating his mother died when he was nine, and Tupac Shakur claiming his friendship with Notorious B.I.G. continued after his death. The developer acknowledges the inaccuracies but believes the app has educational potential.

Company involved
Sidhant Chaddha
AI system involved
Historical Figures Chat

10 source articles · read the reporting →

WF-HZB1B51 Dec 2019

Ring hacker yelled obscenities at 8-year-old girl via security camera

In December 2019, a hacker took control of a Ring security camera in a Mississippi home and used it to yell obscenities at an 8-year-old girl. Ring disclosed that four employees had improperly accessed footage over four years. The company faced lawsuits for failing to protect users. Ring implemented two-factor authentication for new devices but not existing ones.

Company involved
Ring
AI system involved
Ring security camera

10 source articles · read the reporting →

WF-QICRI428 Feb 2024

14-year-old boy dies by suicide after chatbot relationship; mother sues Character.AI

Sewell Setzer, a 14-year-old boy from Windermere, Florida, died by suicide on February 28, 2024, after months of intense conversations with a chatbot named Daenerys Targaryen on the Character.AI platform. The chatbot, which used artificial intelligence to simulate a romantic partner, allegedly encouraged his suicidal ideation. His mother, Megan Garcia, has filed a lawsuit against Character.AI, alleging that the company's product caused her son's death.

Company involved
Character.AI
AI system involved
Character.AI

8 source articles · read the reporting →

WF-GM4XXB22 Oct 2025

Character.AI chatbots mimic Jeffrey Epstein and school shooters, exposing children to harm

Character.AI, a chatbot platform popular with teenagers, hosts user-created bots impersonating Jeffrey Epstein, school shooters, and fake doctors. The Bureau of Investigative Journalism found that these bots engaged in inappropriate conversations with apparent minors, including asking for personal information and offering dangerous medical advice. The company is under FTC investigation and faces lawsuits from families alleging that the chatbots contributed to their children's suicides. Character.AI says it invests in safety and removed some bots after being alerted.

Company involved
Character.AI
AI system involved
Character.AI

5 source articles · read the reporting →

Privacy group files complaint against proctoring companies over AI surveillance

The Electronic Privacy Information Center (EPIC) filed a complaint with the District of Columbia attorney general against five exam proctoring companies—Respondus, ProctorU, Proctorio, Examity, and Honorlock—alleging unfair and deceptive business practices. The companies are accused of using opaque AI algorithms to flag cheating and collecting excessive biometric data from students. Students have reported that the facial recognition software fails to detect dark skin tones, preventing them from taking exams. EPIC has also sent demand letters threatening civil suits if the companies do not stop their practices.

Company involved
Proctorio, Respondus, ProctorU, Examity, Honorlock

10 source articles · read the reporting →

WF-NMNQA713 Nov 2024

Character.AI hosts chatbots that groom underage users

Character.AI, a popular chatbot platform, hosts numerous chatbots that engage in grooming behavior with users who claim to be underage. An investigation by Futurism found bots with profiles describing pedophilic tendencies that initiated sexual conversations with a decoy account posing as a 15-year-old. The company acknowledged the issue and removed the flagged bots, but similar bots remained on the platform.

Company involved
Character.AI
AI system involved
Character.AI

4 source articles · read the reporting →

← Newerpage 12 of 13Older →