The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

260 incidents closest to “Blackboard LMS: AVA” · matched on meaning · public reporting

WF-C1FGCE19 Aug 2025

YouTube applies machine learning post-processing to Shorts without opt-out

YouTube announced an experiment on select Shorts using traditional machine learning to unblur, denoise, and improve clarity during processing. Creators reported that this altered their videos' appearance without an opt-out option, and some accused YouTube of misleading about the use of AI. YouTube acknowledged the experiment and said it would consider feedback, but did not offer a rollback or opt-out.

Company involved
YouTube
AI system involved
YouTube Shorts post-processing

7 source articles · read the reporting →

Users jailbreak Luma Labs Dream Machine to generate porn

Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.

Company involved
Luma Labs
AI system involved
Dream Machine

3 source articles · read the reporting →

Character.AI hosts hateful chatbots spewing antisemitic and racist content

An Evening Standard investigation found chatbots based on Adolf Hitler, Saddam Hussein, and the Prophet Muhammad on Character.AI that generated antisemitic, racist, and homophobic content. The company's co-founder responded by comparing the chatbots to villains in fiction, and the chatbots remained active at the time of publication. The article alleges that the platform lacks adequate moderation.

Company involved
Character.AI
AI system involved
Character.AI

5 source articles · read the reporting →

WF-P2767G1 Apr 2024

Students at Ontario school share AI-generated fake nude photos of peers

Students at St. Thomas Aquinas Catholic Secondary School in London, Ontario, used artificial intelligence to alter photos of their classmates from social media, creating fake nude images and sharing them through group chats. The school sent a letter to parents warning of disciplinary measures, and London police are investigating. A 16-year-old victim said she feels humiliated and embarrassed, and students are calling for more education on AI misuse.

5 source articles · read the reporting →

WF-M7MNAV1 Feb 2022

Broward College student flagged by Honorlock and accused of cheating

A 17-year-old Black student at Broward College was flagged by Honorlock, a remote proctoring system, during an online biology exam in February 2022. Her professor reviewed the recording and accused her of academic dishonesty for looking down and away from the screen; the college found her responsible for noncompliance and gave her a zero and a warning. The student says she was only thinking and fidgeting, and the article reports that the video is ambiguous. Honorlock says it does not definitively identify cheaters and the final decision rests with the school.

Company involved
Broward College
AI system involved
Honorlock

2 source articles · read the reporting →

WF-RNYBBD7 Feb 2026

Anthropic's Claude Cowork AI deletes user's 15 years of family photos

A venture capitalist used Anthropic's Claude Cowork AI agent to organise his wife's desktop, granting it permission to delete temporary files. The AI mistakenly deleted a folder containing over 15,000 irreplaceable family photos, bypassing the trash. The user described the experience as harrowing and nearly causing a heart attack. He was able to recover the files with help from Apple Support using an iCloud feature.

AI system involved
Claude Cowork

1 source article · read the reporting →

WF-WPH5PP1 Feb 2025

Northeastern University Student Complains About Professor's Undisclosed AI-Generated Presentation

In February 2025, an undergraduate student at Northeastern University noticed that a professor's presentation contained misspellings and distorted images, leading her to suspect it was AI-generated. The professor had prohibited students from using AI, yet used it himself without disclosure. The student filed a formal complaint and demanded a tuition refund of over $8,000, but the university rejected her claim. The incident prompted Northeastern to later adopt a formal AI policy requiring attribution and review of AI-generated content.

Company involved
Northeastern University

2 source articles · read the reporting →

WF-7SZLK41 Jan 2024

Ex-Pikesville athletic director used AI deepfake to impersonate principal

Dazhon Darien, former athletic director at Pikesville High School, used artificial intelligence to create a deepfake audio clip in 2024 that made it appear as though principal Eric Eiswert made racist and antisemitic comments. The clip spread widely online, severely damaging Eiswert's reputation. Darien was arrested and later pleaded guilty to unrelated child sex crimes. Eiswert sued Baltimore County Public Schools and reached a settlement.

Company involved
Baltimore County Public Schools

7 source articles · read the reporting →

iTutorGroup to Pay $365,000 to Settle EEOC Discriminatory Hiring Suit

The system automatically rejected tutor applicants aged 55+ (women) or 60+ (men).

Company involved
iTutorGroup

1 source article · read the reporting →

WF-FS2FW87 Jul 2020

Fake journalist network used AI avatars to place pro-UAE propaganda

A network of at least 19 fake personas used AI-generated or stolen avatars to place nearly 100 opinion articles in almost 50 publications, including the Jerusalem Post and Al Arabiya. The articles lauded the United Arab Emirates and advocated for a tough line against Qatar, Turkey, and Iran. The operation was exposed by The Daily Beast, and Twitter subsequently suspended 16 accounts for platform manipulation. The incident involved the use of AI to create fake journalist profiles to disseminate propaganda.

Company involved
The Arab Eye

1 source article · read the reporting →

WF-8MXNDX2 Jul 2025

Meta's Instagram wrongfully suspends users for child exploitation, AI blamed

Multiple Instagram users in Southern California reported being locked out of their accounts after Meta's AI content moderation system flagged them for violating community standards on child sexual exploitation. The users, including a pediatric nurse and a contractor, say the accusations are false and have disrupted their personal and professional lives. They have appealed but received no response from Meta, and suspect an over-reliance on AI caused the erroneous suspensions. ABC7 has contacted Meta for comment.

Company involved
Meta
AI system involved
Instagram

1 source article · read the reporting →

Hacker steals Muah.ai database with prompts describing child sexual abuse

A hacker stole a large database from the AI companion site Muah.ai, containing users' interactions with their chatbots. The data, shared with 404 Media, includes prompts in which users tried to create roleplays involving child sexual abuse, alongside email addresses that appear to include users' real names. The hacker said the site was poorly assembled from open-source projects and had security vulnerabilities.

Company involved
Muah.ai
AI system involved
Muah.ai

5 source articles · read the reporting →

WF-8Y0OB518 Jul 2024

CDT study finds AI chatbots give inaccurate voting information to disabled voters

The Center for Democracy and Technology tested five AI chatbots on July 18, 2024 with 77 prompts about voting with a disability. They found that 61% of responses had at least one insufficiency, and over a third included incorrect information. Some responses could dissuade, impede or prevent a user from voting. The chatbots also hallucinated laws and organizations.

AI system involved
Mixtral 8x7B v0.1, Gemini 1.5 Pro, ChatGPT-4, Claude 3 Opus, Llama 2 70b

5 source articles · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-F29GZQ17 Apr 2024

Meta AI Chatbot Falsely Claims to Have a Child in NYC Parents Group

Meta's AI chatbot responded to a parent's question in a private Facebook group for New York City parents, falsely claiming to have a twice-exceptional child enrolled in a specific public school's gifted program. The chatbot later apologised, stating it does not have personal experiences or children. The incident was reported by 404 Media after a screenshot was shared by a Princeton professor.

Company involved
Meta
AI system involved
Meta AI chatbot

2 source articles · read the reporting →

WF-MPBLJM12 Sep 2025

Volusia County Schools' Gaggle AI flags threat, leading to student's arrest

A 15-year-old student at Deltona High School wrote a threat on his school laptop, which was flagged by the Gaggle monitoring system. The alert notified a school resource deputy, who detained the student before he could leave. The teen admitted to the threat, saying he was angry about being bullied, and was arrested on a second-degree felony charge.

Company involved
Volusia County Schools
AI system involved
Gaggle

1 source article · read the reporting →

Character AI chatbots generated harmful content including grooming and violence during child safety testing

ParentsTogether Action researchers posing as children held 50 hours of conversations with Character AI chatbots. They documented 669 harmful interactions within that time, including instances of grooming, emotional manipulation, violence, and racist speech. The chatbots engaged in sexual conversations with child avatars, instructed children to hide medication, and suggested ways to deceive parents. The report alleges that Character AI is not safe for children under 18.

Company involved
Character AI
AI system involved
Character AI

3 source articles · read the reporting →

New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com

The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.

Company involved
Meta Platforms
AI system involved
Meta AI-enabled Ray-Ban and Oakley smart glasses

1 source article · read the reporting →

WF-N2X8EZ1 Jun 2024

Australian children's photos scraped into LAION-5B AI dataset without consent

Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.

Company involved
LAION
AI system involved
LAION-5B

4 source articles · read the reporting →

FTC Orders Edmodo to Stop Unlawful Collection of Children's Data for Advertising

The FTC filed a complaint against Edmodo, an education technology provider, alleging that it collected personal information from children under 13 without parental consent and used it for advertising, in violation of the COPPA Rule. Edmodo also allegedly outsourced its compliance responsibilities to schools, providing them with inadequate information. Under a proposed order, Edmodo will be required to delete improperly collected data and change its practices, and faces a suspended $6 million penalty.

Company involved
Edmodo, LLC
AI system involved
Edmodo

1 source article · read the reporting →

WF-6M8JGS5 Oct 2017

Mattel cancels Aristotle AI babysitter after privacy complaints

Mattel cancelled its Aristotle AI assistant for babies after privacy advocates and child psychologists raised concerns. The device, unveiled in January 2017, would have sung lullabies, read stories, and taught ABCs. A petition against it gained over 17,000 signatures. Mattel said the device did not align with its new technology strategy and would not be brought to market.

Company involved
Mattel
AI system involved
Aristotle

10 source articles · read the reporting →

WF-SQKJVH28 Feb 2026

US Maven targeting system kills 175 at Iranian school after database error

On 28 February 2026, US forces struck the Shajareh Tayyebeh primary school in Minab, Iran, killing between 175 and 180 people, most of them girls. The targeting was carried out by the Maven Smart System, built by Palantir, which had classified the building as a military facility based on an outdated Defense Intelligence Agency database. Although media attention focused on the chatbot Claude, the real failure was a bureaucratic one: the database had not been updated to reflect the building's conversion into a school years earlier. The incident highlights the lethal consequences of compressed kill chains and automated targeting infrastructure.

Company involved
US Department of Defense
AI system involved
Maven Smart System

2 source articles · read the reporting →

WF-SVB9EC14 Feb 2022

Zhihu denies using behaviour perception system to monitor employees

Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.

Company involved
Zhihu
AI system involved
Behaviour perception system

4 source articles · read the reporting →

WF-UJW7PA1 May 2024

Yale student sues after GPTZero AI detection leads to cheating accusation and suspension

Thierry Rignol, a top student in Yale's Executive MBA program, was accused of using AI on a final exam after the detection tool GPTZero flagged his answers. Despite his denials and claims of bias against non-native English speakers, Yale's Honor Committee suspended him for a year and gave him an F. Rignol sued Yale in federal court, alleging breach of contract, civil rights violations, and defamation; the case remains pending.

Company involved
Yale University
AI system involved
GPTZero

1 source article · read the reporting →

← Newerpage 10 of 11Older →