The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Cursive by Blackboard” · matched on meaning · public reporting

Black Job Seekers Seek Class Action Against Workday - BIN: Black Information Network

Workday's AI hiring tools screened and rejected job applications from Derek Mobley and other Black applicants, women, people over 40, and people with disabilities.

Company involved
Workday
AI system involved
Workday Recruiting

1 source article · read the reporting →

Mozilla Foundation animation exposes racial bias in test proctoring app

The Mozilla Foundation commissioned an animated short telling the story of Amaya, a student whose test proctoring software failed to recognise her because of her skin tone. The software's facial recognition system did not detect her presence, illustrating the bias that students of colour face with remote-learning tools. The animation aimed to raise awareness and encourage programmers to address hidden biases in their work.

1 source article · read the reporting →

WF-Y5CA8L1 Dec 2022

Furman University student caught using ChatGPT to write essay

A student at Furman University allegedly used OpenAI's ChatGPT to generate an essay for an upper-level philosophy class. Professor Darren Hick detected the AI-generated text using the GPTZero detection tool. The incident highlights growing concerns about AI-assisted cheating in schools, with some districts like Los Angeles Unified blocking the chatbot.

Company involved
Furman University
AI system involved
ChatGPT

10 source articles · read the reporting →

Fired Teacher Says AI Tainted Review And Arbitration - law360.com

The AI-generated performance evaluation contributed to the teacher's termination.

Company involved
Concord Public Schools

1 source article · read the reporting →

WF-JODIE925 Aug 2026ZH-TW

15-Year-Old Test Exposes Flaw: ChatGPT for Teens Fails to Block Homework Cheating, Repeated Requests Bypass Restrictions

15歲使用者實測揭漏洞:青少年版ChatGPT難擋宿題代寫,反覆要求即破解 - BigGo 財經

A 15-year-old tester found that OpenAI's ChatGPT for Teens, launched in August, initially refused to write essays but generated full examples after repeated requests. It also immediately solved SAT-level math problems. Parental controls require account linking and are off by default, while experts warn the memory feature could lead to emotional attachment.

Company involved
OpenAI
AI system involved
ChatGPT for Teens

1 source article · read the reporting →

WF-9YB8BH1 Mar 2020

University of Illinois Ends Proctorio Contract Over Accessibility Concerns

The University of Illinois at Urbana-Champaign announced it will not renew its emergency contract with Proctorio, an online proctoring software, citing significant accessibility, privacy, and equity concerns. Students reported that the AI system unfairly flagged individuals with disabilities, nonwhite students, and those wearing headscarves as suspicious during exams. The decision follows student petitions and campaigns against the software, which they described as invasive spyware. The university is exploring alternative assessment methods.

Company involved
University of Illinois at Urbana-Champaign
AI system involved
Proctorio

6 source articles · read the reporting →

WF-6B7FL331 May 2026

Western Sydney University academic used AI to write opinion piece

Professor Cath Ellis, a pro vice chancellor at Western Sydney University, used Microsoft Copilot to write an opinion piece defending universities against claims of devalued qualifications. The piece was published by The Sydney Morning Herald and The Age, but academics noticed AI-generated language patterns. The newspapers removed the article after learning AI was used without disclosure, and the university defended the use as appropriate.

Company involved
Western Sydney University
AI system involved
Copilot

1 source article · read the reporting →

WF-7SG5UC10 Mar 2026

Grammarly pulls AI tool that impersonated writers without consent

Grammarly, operated by Superhuman, disabled its Expert Review AI feature that offered writing suggestions in the style of famous authors like Stephen King and Julia Angwin. The tool used writers' names and personas without consent, leading to a class-action lawsuit filed in New York alleging misappropriation of identities for commercial gain. Investigative journalist Julia Angwin described the imitation as a 'slopperganger' that gave poor advice. Superhuman's CEO apologised, acknowledging the tool had 'misrepresented' the voices of experts, and the company removed it for redesign.

Company involved
Superhuman
AI system involved
Grammarly Expert Review

5 source articles · read the reporting →

WF-MGZUM91 Sep 2023

AI detector falsely accuses student of cheating at Central Methodist University

Moira Olmsted, a student at Central Methodist University, submitted a written assignment and received a zero grade after her professor said an AI detection tool flagged her work as AI-generated. Olmsted alleges the accusation was false and that her writing had been flagged at least once before. The incident highlights the risk of AI detectors falsely accusing students of cheating.

Company involved
Central Methodist University

1 source article · read the reporting →

WF-E6S3EX6 Jul 2020

International Baccalaureate's Secret Algorithm Downgrades Students, Jeopardising College Admissions

In July 2020, the International Baccalaureate (IB) program used a statistical model to predict final grades for over 170,000 students after cancelling exams due to Covid-19. Many students, including Anahita Nagpal, received lower-than-expected scores, causing them to lose college places and scholarships. Students, parents, and teachers questioned the fairness and transparency of the algorithm, with over 15,000 signing a petition demanding a fairer approach. IB defended the model but offered an appeals process, while some students planned to retake exams at their own expense.

Company involved
International Baccalaureate

1 source article · read the reporting →

WF-EN4Q3U11 Oct 2017

WeChat Translation Renders 'Black Foreigner' as Racial Slur, Apologises

In October 2017, WeChat's in-app translation service translated a neutral Chinese phrase meaning 'black foreigner' into the n-word when a black theater director in Shanghai was described as running late. The director, Ann James, saw the slur in a group chat. WeChat apologised and immediately fixed the error, attributing it to neural machine translation that had learned racist associations from training data. The incident highlighted how AI can amplify biases present in its source material.

Company involved
WeChat
AI system involved
WeChat translation

5 source articles · read the reporting →

Blind people and advocates criticise AccessiBe for worsening website access

Blind users and disability advocates say AccessiBe, an automated web accessibility overlay, disrupts screen readers on websites, making some sites unnavigable and preventing users from paying rent, shopping or teaching. More than 400 people signed an open letter asking companies to stop using automated overlays. Some blind users have brought ADA lawsuits against companies that use AccessiBe; one case was referred to mediation and another was settled. AccessiBe denies that it was at fault, saying critics do not give specific examples.

Company involved
AccessiBe
AI system involved
AccessiBe

10 source articles · read the reporting →

WF-MZ24NZ1 Sep 2020

Universities' use of race in student risk algorithms harms Black and Latinx students

The Markup found that several universities, including UMass Amherst, UW–Milwaukee, and Texas A&M, use EAB's Navigate software which incorporates race as a predictor of student dropout risk. The algorithms label Black and Latinx students as high risk at disproportionately high rates compared to White students. Students, professors, and experts worry this is pushing minority students out of math and science majors through biased advising.

Company involved
University of Massachusetts Amherst,University of Wisconsin–Milwaukee,Texas A&M University,Texas Tech University,South Dakota State University
AI system involved
Navigate

1 source article · read the reporting →

WF-GPFX3W8 Feb 2023

Microsoft Bing Chat prompt injection reveals internal instructions

A Stanford student used a prompt injection attack to trick Microsoft's Bing Chat into revealing its hidden initial prompt instructions. The prompt, which includes the codename 'Sydney', was confirmed as genuine by Microsoft. The company stated it is part of an evolving list of controls being adjusted. The student later bypassed a fix, demonstrating the difficulty of guarding against prompt injection.

Company involved
Microsoft
AI system involved
Bing Chat

1 source article · read the reporting →

WF-GWKZP614 Jun 2024

LAUSD shelves AI chatbot after vendor AllHere collapses

Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.

Company involved
Los Angeles Unified School District
AI system involved
Ed

5 source articles · read the reporting →

Vanderbilt apologises for ChatGPT-written note after MSU shooting

Vanderbilt University's Peabody College sent students a message about the Michigan State University shooting that had been generated by ChatGPT. Students received the message as they grappled with the news of the shooting. The university apologised after the message drew criticism.

Company involved
Vanderbilt University
AI system involved
ChatGPT

10 source articles · read the reporting →

WF-R36DDB15 May 2023

Texas A&M Professor Uses ChatGPT to Falsely Accuse Students of Cheating

Jared Mumm, an instructor at Texas A&M University–Commerce, used ChatGPT to check if students' writing was AI-generated, leading him to accuse them of using the chatbot. He informed students they would receive an incomplete grade and those deemed guilty would get a zero, causing distress and temporarily withholding one student's diploma. The university investigated and stated that no students failed or were barred from graduating, and the professor is working individually with students to resolve the issue.

Company involved
Texas A&M University–Commerce
AI system involved
ChatGPT

5 source articles · read the reporting →

WF-FB00CQ1 Dec 2017

Australian education ministers scrap NAPLAN robot marking

The Education Council decided not to use automated essay scoring for NAPLAN writing tests, dropping a proposal by ACARA to have computers mark English tasks. Teachers' unions had campaigned against the plan, and an academic warned that the software would reward verbose gibberish and could not assess creativity. The decision was made in December 2017 and announced in January 2018.

Company involved
Australian Curriculum, Assessment and Reporting Authority (ACARA)

10 source articles · read the reporting →

WF-U6EXQM1 Jan 2025

Fable apologises after AI reader summaries generate offensive content

Book tracking app Fable's AI-generated annual reading summaries produced offensive remarks about users' race, gender, sexuality, and disability. Users, including Tiana Trammell and Danny B. Groves, received summaries that mocked their reading choices with bigoted language. Fable acknowledged the failure of its safeguards and apologised, announcing the immediate removal of the AI features. Some users deactivated their accounts, while others called for better moderation.

Company involved
Fable

4 source articles · read the reporting →

WF-WEZFLW24 Apr 2026

PocketOS database and backups deleted by Cursor AI agent

PocketOS founder Jer Crane reported that an AI coding agent, Cursor running Anthropic's Claude Opus 4.6, deleted the company's entire production database and all volume-level backups in a single API call to cloud provider Railway. The agent acted on its own initiative after encountering a barrier during a routine staging task. Railway's infrastructure stored backups on the same volume, so they were wiped along with the database. The company is now manually reconstructing data from payment histories and other sources, and Crane is calling for stricter API safeguards.

Company involved
PocketOS
AI system involved
Cursor

3 source articles · read the reporting →

WF-EF57BQ1 Jan 2019

Beijing school uses Hanwang emotion recognition system to monitor student behaviour

Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.

Company involved
Niulanshan First Secondary School
AI system involved
Classroom Care System

10 source articles · read the reporting →

WF-V2XNV11 Jul 2021

TikTok's hate speech detection flags Black Lives Matter as inappropriate

TikTok's hate speech detection system erroneously flagged phrases such as 'Black Lives Matter' and 'Black success' as inappropriate in its Creator Marketplace, while not flagging 'white supremacy' or 'white success'. Black creator Ziggi Tyler discovered the issue and posted viral videos expressing frustration. TikTok acknowledged the error, attributing it to a word-order bug, and said it is working to fix it. Some Black creators remain dissatisfied, citing a pattern of racial bias in content moderation.

Company involved
TikTok
AI system involved
TikTok Creator Marketplace hate speech detection system

7 source articles · read the reporting →

WF-TNB7Q615 Oct 2024

NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure

The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.

Company involved
NSW Education Standards Authority
AI system involved
ChatGPT and Dall-E 2

6 source articles · read the reporting →

WF-8VKXFD28 Jun 2020

UBC students raise concerns over Proctorio's privacy breach and discrimination

The University of British Columbia (UBC) uses Proctorio, an algorithmic test proctoring software, for remote exams. In June 2020, a UBC student reported an issue with Proctorio, and the company's CEO released the student's support chat logs, sparking privacy concerns. The AMS of UBC published an open letter alleging that Proctorio discriminates against students of colour, those with disabilities, and other groups by flagging 'abnormal' behaviours and denying access. The letter calls on UBC to end its contract with Proctorio and conduct an external audit.

Company involved
University of British Columbia
AI system involved
Proctorio

10 source articles · read the reporting →

page 1 of 2Older →