The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

140 incidents closest to “Blackboard Ally” · matched on meaning · public reporting

WF-DGDWU21 Feb 2024

SoundCloud revises AI training terms after artist backlash

SoundCloud faced criticism after artists and AI experts spotted a February 2024 Terms of Use update that appeared to allow the platform to use uploaded content to train AI models. CEO Eliah Seton responded on May 14, 2025, saying the language was 'too broad' and announcing revised terms that rule out training generative AI on artists' content without explicit opt-in consent. SoundCloud maintains it never actually used artist content to train AI models.

Company involved
SoundCloud

4 source articles · read the reporting →

WF-IG5R9T9 Apr 2024

Texas uses AI to grade student STAAR test answers

The Texas Education Agency will use an automated scoring engine to grade written answers on the 2023 STAAR tests, replacing thousands of human graders. The system uses natural language processing and will initially score all responses, with a quarter rescored by humans. Educators have expressed concerns about the system's fairness and the potential for errors, especially for creative or non-standard answers.

Company involved
Texas Education Agency
AI system involved
automated scoring engine

10 source articles · read the reporting →

Evolv weapon detection system falsely flags Chromebooks as weapons

Evolv's AI-based weapon detection system has been reported to falsely identify certain Chromebook laptops as weapons, causing false alarms at security checkpoints. The system is used in venues such as schools. The article discusses the flaw and user experiences. No official response from Evolv has been mentioned.

Company involved
Evolv
AI system involved
Evolv

5 source articles · read the reporting →

Slack trains AI features on user messages and files by default

Slack uses user messages, files, and data to train its machine learning features such as channel recommendations and emoji suggestions. Users are opted in by default and cannot individually opt out; only workspace administrators can request exclusion via email. A user publicly criticized the practice, and Slack acknowledged the policy but did not change it.

Company involved
Slack

10 source articles · read the reporting →

WF-X0LJEA1 Jan 2020

Voice actors sue LOVO over alleged theft of voices for AI training

Voice actors Paul Skye Lehrman and Linnea Sage filed a proposed class action against AI startup LOVO, alleging the company misappropriated their voices to train its text-to-speech system Genny. The actors claim they were hired on Fiverr under the pretence of academic research but later discovered their voices were used commercially without consent. Lehrman reports a 50% decline in work and loss of control over how his voice is used. The lawsuit, filed in New York federal court, seeks to represent other affected voiceover artists and obtain a court order blocking the practice.

Company involved
LOVO
AI system involved
Genny

6 source articles · read the reporting →

WF-4N6UFD1 Mar 2021

Baltimore schools monitor student laptops for suicide signs using GoGuardian Beacon

Baltimore City Public Schools uses GoGuardian Beacon software to monitor student laptops for signs of suicide. Since March 2021, the system has flagged 786 alerts, with nine students taken to emergency rooms. Privacy advocates warn the monitoring could lead to disciplinary actions, outing of LGBTQ students, and disproportionately affect disadvantaged students. School officials defend the practice as a safeguard.

Company involved
Baltimore City Public Schools
AI system involved
GoGuardian Beacon

10 source articles · read the reporting →

Amazon's Alexa makes racist remarks about Black girls and boys

Amazon's Alexa voice assistant provided racist descriptions when asked about African-American girls and boys. Researchers reported that the device said African-American girls are the fastest growing segment of the juvenile justice system and that African-American boys are struggling readers. The article notes that such responses can harm children's confidence and highlights ongoing issues of racial bias in AI systems.

Company involved
Amazon
AI system involved
Alexa

10 source articles · read the reporting →

Meta's AI model is being used to create sexual chatbots

Meta released an AI model that allows people to make their own chatbots. Some users are employing it to create sexual chatbots, including one named Allie, an 18-year-old character who engages in graphic rape and abuse fantasies. The article presents this as a potential danger of open-source AI to society.

Company involved
Meta

9 source articles · read the reporting →

WF-WW27TM1 Jul 2023

Anti-piracy group takes down Books3 dataset used to train Meta's LLaMA

The Danish anti-piracy group Rights Alliance sent a DMCA takedown request to The Eye, which hosted the Books3 dataset containing 196,640 copyrighted books. The dataset was used by Meta to train its LLaMA language model. Authors including Sarah Silverman have filed a class action lawsuit against Meta for using their works without permission. The dataset has been taken offline, but copies remain available.

Company involved
Meta
AI system involved
LLaMA

10 source articles · read the reporting →

UN warns AI technology used to distort Holocaust history

The UN's education body Unesco warned that AI tools such as ChatGPT, Gemini and Bard are being used to generate false narratives about the Holocaust, including invented events and fabricated witnesses. The report highlights instances where hackers rigged chatbots to spread Nazi ideology and AI models created deepfakes of historical figures. Unesco called for ethical safeguards and education to counter the spread of anti-Semitism.

9 source articles · read the reporting →

LinkedIn removes AI 'co-worker' accounts that were seeking jobs

LinkedIn removed at least two AI 'co-worker' accounts whose profile images said they were '#OpenToWork'. One account named Ella claimed it would outperform any social media team and needed no coffee breaks. The article does not specify further consequences.

Company involved
LinkedIn
AI system involved
AI 'co-worker' account 'Ella'

4 source articles · read the reporting →

WF-0TL85K1 Mar 2024

AfD used AI-generated images for political propaganda on TikTok

In the months before the 2024 European elections, Alternative für Deutschland (AfD) politician Maximilian Krah used AI-generated images on TikTok to create false visual evidence of fictional families, staged nationalist demonstrations, and immigration threats. The AI-generated content was posted to amplify anxieties around migration and cultural identity, with over 1.3 million views across 28 thumbnails. The article alleges that the AfD continued this practice after the elections, weaponizing AI to deepen political divides.

Company involved
Alternative für Deutschland (AfD)

5 source articles · read the reporting →

ADL reports Suno AI tool was used to generate hateful songs

An ADL report says extremists have used Suno, a generative AI music-creation tool, to produce songs containing antisemitic, racist, xenophobic and violent content. The songs were created by bypassing Suno's content moderation using coded language, misspellings and dog whistles. ADL contacted Suno and Microsoft but received no response.

Company involved
Suno AI
AI system involved
Suno

6 source articles · read the reporting →

WF-GV5HWV21 Oct 2019

Starship delivery robots blocked wheelchair users at University of Pittsburgh

In October 2019, Starship Technologies' autonomous delivery robots blocked wheelchair users on the University of Pittsburgh campus. Doctoral student Emily Ackerman reported that a robot blocked the only accessible sidewalk entrance, trapping her near traffic. Another wheelchair user, Alisa Grishman, had a similar incident earlier that month. The university and Starship paused the robot program for review.

Company involved
Starship Technologies
AI system involved
Starship delivery robot

4 source articles · read the reporting →

Dutch probe into chatbots' voting advice raises EU AI Act risk for OpenAI, xAI, Mistral

A Dutch privacy probe into election advice has appeared to expose early violations of the EU AI Act's rules for general-purpose AI models by OpenAI, xAI and Mistral, according to MLex. The companies' chatbots provided distorted voting advice to users. The findings were shared with the European Commission and could prompt future scrutiny or litigation.

Company involved
OpenAI, xAI and Mistral

6 source articles · read the reporting →

News/Media Alliance study finds unauthorised use of publisher content to train AI

The News/Media Alliance alleges that generative AI developers have copied and used publishers' content without authorisation to train large language models. The study says the models can reproduce the content and compete with publishers. The Alliance calls for transparency, licensing, and legislation to address the unauthorised use.

10 source articles · read the reporting →

Meta's cross-check program delays removal of violating content for privileged users

The Oversight Board's policy advisory opinion on Meta's cross-check program found that the system grants certain users, such as business partners and celebrities, additional human review before removing violating content, while ordinary users face immediate removal. This unequal treatment allows potentially harmful content to remain on the platform for days, and Meta has failed to track whether the program improves accuracy. The Board made 32 recommendations to address these flaws.

Company involved
Meta
AI system involved
cross-check program

10 source articles · read the reporting →

School AI surveillance like Gaggle can lead to false alarms, arrests

AI surveillance tools used in schools, such as Gaggle, GoGuardian and Bark, are reported to generate false alarms that have led to student arrests. The article examines cases where automated monitoring flagged innocent behaviour as threats, causing harm to students and families.

2 source articles · read the reporting →

WF-9F92BD14 Nov 2019

UK prison risk algorithm may embed racial bias, experts warn

The Ministry of Justice developed a digital tool to categorize prisoners, which experts and advocacy groups warn could automate and embed racism. The tool uses intelligence data that may reflect existing bias, potentially leading to disproportionate categorization of BAME prisoners. The MoJ claims no evidence of discrimination, but critics question the small trial sample and lack of transparency.

Company involved
Ministry of Justice
AI system involved
Digital prisoner categorisation tool

5 source articles · read the reporting →

WF-PCWX3U1 Jan 2024

OpenAI's GPT Store hosts copyright-infringing chatbots

Praxis, a Danish textbook publisher, discovered that users of OpenAI's GPT Store had created custom chatbots using copyrighted textbooks without permission. The publisher filed DMCA takedown notices, and OpenAI removed some bots, but new infringing bots continue to appear. Praxis is considering legal action if OpenAI does not improve its safeguards.

Company involved
OpenAI
AI system involved
GPT Store

3 source articles · read the reporting →

Character.AI hosts hateful chatbots spewing antisemitic and racist content

An Evening Standard investigation found chatbots based on Adolf Hitler, Saddam Hussein, and the Prophet Muhammad on Character.AI that generated antisemitic, racist, and homophobic content. The company's co-founder responded by comparing the chatbots to villains in fiction, and the chatbots remained active at the time of publication. The article alleges that the platform lacks adequate moderation.

Company involved
Character.AI
AI system involved
Character.AI

5 source articles · read the reporting →

WF-M7MNAV1 Feb 2022

Broward College student flagged by Honorlock and accused of cheating

A 17-year-old Black student at Broward College was flagged by Honorlock, a remote proctoring system, during an online biology exam in February 2022. Her professor reviewed the recording and accused her of academic dishonesty for looking down and away from the screen; the college found her responsible for noncompliance and gave her a zero and a warning. The student says she was only thinking and fidgeting, and the article reports that the video is ambiguous. Honorlock says it does not definitively identify cheaters and the final decision rests with the school.

Company involved
Broward College
AI system involved
Honorlock

2 source articles · read the reporting →

WF-WPH5PP1 Feb 2025

Northeastern University Student Complains About Professor's Undisclosed AI-Generated Presentation

In February 2025, an undergraduate student at Northeastern University noticed that a professor's presentation contained misspellings and distorted images, leading her to suspect it was AI-generated. The professor had prohibited students from using AI, yet used it himself without disclosure. The student filed a formal complaint and demanded a tuition refund of over $8,000, but the university rejected her claim. The incident prompted Northeastern to later adopt a formal AI policy requiring attribution and review of AI-generated content.

Company involved
Northeastern University

2 source articles · read the reporting →

X's algorithm amplifies right-wing and extreme content, Sky News investigation finds

A Sky News investigation found that X's algorithm amplifies right-wing and extreme content. The Data and Forensics team conducted a nine-month investigation into the platform's recommendation system. The findings indicate that the algorithm boosts such content, potentially influencing political discourse in the UK.

Company involved
X
AI system involved
X's algorithm

4 source articles · read the reporting →

← Newerpage 5 of 6Older →