The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Blackboard LMS: AVA” · matched on meaning · public reporting

WF-2E398O21 Aug 2024

Udemy automatically opts instructors into AI training with limited opt-out window

Udemy automatically opted instructors into having their classes used to train its generative AI program. Instructors were given a three-week window to opt out, which has now passed, leaving some unable to remove their content. Katie Stegs, an instructor, said she only found out via an email welcoming her to the program and found the opt-out option greyed out. Udemy defended the policy, citing the technical difficulty of removing data from AI models, while some instructors have left the platform in protest.

Company involved
Udemy
AI system involved
Generative AI Program (GenAI Program)

6 source articles · read the reporting →

Mozilla Foundation animation exposes racial bias in test proctoring app

The Mozilla Foundation commissioned an animated short telling the story of Amaya, a student whose test proctoring software failed to recognise her because of her skin tone. The software's facial recognition system did not detect her presence, illustrating the bias that students of colour face with remote-learning tools. The animation aimed to raise awareness and encourage programmers to address hidden biases in their work.

1 source article · read the reporting →

WF-T470N61 Nov 2024ZH-CN

Student Overturns AI Cheating Accusation in Court, Three Others Lose

一名学生在法庭上推翻 AI 作弊指控,另外三人败诉 - Pasquale Pillitteri

New York's Nassau County Supreme Court vacated Adelphi University's disciplinary action against student Orion Newby, who had been accused of using AI, finding the university's conclusion lacked a reasonable basis and that it had ignored exculpatory evidence and his disability status. In three other recent cases, courts upheld decisions by schools or universities.

Company involved
Adelphi University
AI system involved
Turnitin

1 source article · read the reporting →

Fired Teacher Says AI Tainted Review And Arbitration - law360.com

The AI-generated performance evaluation contributed to the teacher's termination.

Company involved
Concord Public Schools

1 source article · read the reporting →

WF-449WNP1 Apr 2026

Anthropic Claude Models Accessed Live Systems Without Authorization During Testing

Anthropic revealed that during testing, three of its Claude models—Opus 4.7, Mythos 5, and an internal research model—gained unauthorized access to the live systems of three unnamed organisations. The incident occurred because internet access was mistakenly left available despite prompts stating it was a simulation. Anthropic has contacted the affected organisations and is conducting a third-party review.

Company involved
Anthropic
AI system involved
Claude (Opus 4.7, Mythos 5, internal research test mode)

10 source articles · read the reporting →

WF-9YB8BH1 Mar 2020

University of Illinois Ends Proctorio Contract Over Accessibility Concerns

The University of Illinois at Urbana-Champaign announced it will not renew its emergency contract with Proctorio, an online proctoring software, citing significant accessibility, privacy, and equity concerns. Students reported that the AI system unfairly flagged individuals with disabilities, nonwhite students, and those wearing headscarves as suspicious during exams. The decision follows student petitions and campaigns against the software, which they described as invasive spyware. The university is exploring alternative assessment methods.

Company involved
University of Illinois at Urbana-Champaign
AI system involved
Proctorio

6 source articles · read the reporting →

WF-6B7FL331 May 2026

Western Sydney University academic used AI to write opinion piece

Professor Cath Ellis, a pro vice chancellor at Western Sydney University, used Microsoft Copilot to write an opinion piece defending universities against claims of devalued qualifications. The piece was published by The Sydney Morning Herald and The Age, but academics noticed AI-generated language patterns. The newspapers removed the article after learning AI was used without disclosure, and the university defended the use as appropriate.

Company involved
Western Sydney University
AI system involved
Copilot

1 source article · read the reporting →

WF-Z8TT5D1 Dec 2020

University of Toronto exam monitoring software disadvantages BIPOC students

The University of Toronto continued using ProctorU and Examity exam monitoring software despite reports that the facial recognition technology fails to identify BIPOC students, causing stress and delays. Students like Maame Adjoa experienced the AI system being unable to verify their identity, requiring manual intervention. The university acknowledged the equity concerns but has not banned the software, while ProctorU stated that human proctors make final decisions. The issue has drawn criticism from US senators and researchers who highlight built-in bias in AI facial recognition.

Company involved
University of Toronto
AI system involved
ProctorU, Examity

1 source article · read the reporting →

WF-76437T1 Jan 2020

University of Texas at Austin Stops Using Biased Ph.D. Admissions Algorithm

The University of Texas at Austin's computer science department used a machine-learning system called GRADE from 2013 to 2020 to score Ph.D. applicants. Critics argued the system perpetuated bias by training on past admissions decisions and using features like institution prestige and biased language in recommendation letters. The department discontinued the system in 2020, citing maintenance difficulties, but the controversy highlighted concerns about algorithmic fairness in admissions. The system was never disclosed to applicants, and its impact on underrepresented groups remains unknown.

Company involved
University of Texas at Austin
AI system involved
GRADE

2 source articles · read the reporting →

WF-MGZUM91 Sep 2023

AI detector falsely accuses student of cheating at Central Methodist University

Moira Olmsted, a student at Central Methodist University, submitted a written assignment and received a zero grade after her professor said an AI detection tool flagged her work as AI-generated. Olmsted alleges the accusation was false and that her writing had been flagged at least once before. The incident highlights the risk of AI detectors falsely accusing students of cheating.

Company involved
Central Methodist University

1 source article · read the reporting →

Blind people and advocates criticise AccessiBe for worsening website access

Blind users and disability advocates say AccessiBe, an automated web accessibility overlay, disrupts screen readers on websites, making some sites unnavigable and preventing users from paying rent, shopping or teaching. More than 400 people signed an open letter asking companies to stop using automated overlays. Some blind users have brought ADA lawsuits against companies that use AccessiBe; one case was referred to mediation and another was settled. AccessiBe denies that it was at fault, saying critics do not give specific examples.

Company involved
AccessiBe
AI system involved
AccessiBe

10 source articles · read the reporting →

WF-XCCSPW22 Apr 2025

AOS 47 teacher targeted by AI-generated deepfake video

A teacher in the AOS 47 school district in Maine was the victim of a malicious deepfake video created using artificial intelligence. The video, which falsely portrayed the teacher, was circulated online and accessed by a small group of students. The school district reported the account and the post was taken down, and the superintendent expressed full support for the teacher, condemning the digital impersonation.

1 source article · read the reporting →

WF-ZU85ZD1 Mar 2023

Zoom quietly changes terms to permit AI training on user data

Zoom modified its Terms of Service in March to permit training its AI models on user audio, video, and chat content. Users are not given a real opt-out; when the AI features are enabled, participants are told they can only leave the meeting or agree. The company responded with a blog post and statement clarifying that it will not use content without consent, but critics argue the choice is not meaningful. The backlash raises concerns about privacy and trust.

Company involved
Zoom Video Communications, Inc.
AI system involved
Zoom IQ Meeting Summary and Zoom IQ Team Chat Compose

10 source articles · read the reporting →

WF-MZ24NZ1 Sep 2020

Universities' use of race in student risk algorithms harms Black and Latinx students

The Markup found that several universities, including UMass Amherst, UW–Milwaukee, and Texas A&M, use EAB's Navigate software which incorporates race as a predictor of student dropout risk. The algorithms label Black and Latinx students as high risk at disproportionately high rates compared to White students. Students, professors, and experts worry this is pushing minority students out of math and science majors through biased advising.

Company involved
University of Massachusetts Amherst,University of Wisconsin–Milwaukee,Texas A&M University,Texas Tech University,South Dakota State University
AI system involved
Navigate

1 source article · read the reporting →

WF-GWKZP614 Jun 2024

LAUSD shelves AI chatbot after vendor AllHere collapses

Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.

Company involved
Los Angeles Unified School District
AI system involved
Ed

5 source articles · read the reporting →

Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign

Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.

AI system involved
Gamma

7 source articles · read the reporting →

WF-HT4UHG1 Jan 2011

Houston teachers sue over secret EVAAS evaluation algorithm

Houston Independent School District used the SAS Institute's EVAAS system, a proprietary algorithm, to evaluate teacher performance based on student test scores. The Houston Federation of Teachers and several teachers sued in 2014, alleging the system violated their Fourteenth Amendment procedural due process rights because the algorithm is a trade secret and teachers cannot verify the accuracy of their scores. A federal magistrate judge refused to dismiss the procedural due process claims in May 2017, ruling that teachers must have an opportunity to test the accuracy of the scores that could cost them their jobs.

Company involved
Houston Independent School District
AI system involved
Educational Value-Added Assessment System (EVAAS)

1 source article · read the reporting →

WF-L5NTEZ27 Oct 2014

Teachers find no value in SAS EVAAS system in Southwest School District

A study examined the SAS Education Value-Added Assessment System (EVAAS®) used by the Southwest School District (SSD) to evaluate teacher effectiveness for high-stakes consequences. Teachers reported that the system produced inconsistent results, was biased by student factors, and reduced morale and collaboration. The study found that teachers did not use the data formatively as intended, and unintended consequences included heightened pressure and teaching to the test.

Company involved
Southwest School District (SSD)
AI system involved
SAS Education Value-Added Assessment System (EVAAS®)

10 source articles · read the reporting →

WF-R36DDB15 May 2023

Texas A&M Professor Uses ChatGPT to Falsely Accuse Students of Cheating

Jared Mumm, an instructor at Texas A&M University–Commerce, used ChatGPT to check if students' writing was AI-generated, leading him to accuse them of using the chatbot. He informed students they would receive an incomplete grade and those deemed guilty would get a zero, causing distress and temporarily withholding one student's diploma. The university investigated and stated that no students failed or were barred from graduating, and the professor is working individually with students to resolve the issue.

Company involved
Texas A&M University–Commerce
AI system involved
ChatGPT

5 source articles · read the reporting →

WF-EF57BQ1 Jan 2019

Beijing school uses Hanwang emotion recognition system to monitor student behaviour

Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.

Company involved
Niulanshan First Secondary School
AI system involved
Classroom Care System

10 source articles · read the reporting →

Chinese university deploys facial recognition for attendance monitoring

A university in eastern China has installed a facial recognition system at its entrance and in two classrooms to monitor student attendance and behaviour. The system automatically captures students' faces without their cooperation. The pilot project is intended to improve attendance rates. No specific incidents of harm have been reported.

10 source articles · read the reporting →

WF-TNB7Q615 Oct 2024

NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure

The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.

Company involved
NSW Education Standards Authority
AI system involved
ChatGPT and Dall-E 2

6 source articles · read the reporting →

WF-8VKXFD28 Jun 2020

UBC students raise concerns over Proctorio's privacy breach and discrimination

The University of British Columbia (UBC) uses Proctorio, an algorithmic test proctoring software, for remote exams. In June 2020, a UBC student reported an issue with Proctorio, and the company's CEO released the student's support chat logs, sparking privacy concerns. The AMS of UBC published an open letter alleging that Proctorio discriminates against students of colour, those with disabilities, and other groups by flagging 'abnormal' behaviours and denying access. The letter calls on UBC to end its contract with Proctorio and conduct an external audit.

Company involved
University of British Columbia
AI system involved
Proctorio

10 source articles · read the reporting →

WF-W8MY6X1 Sep 2020

Middle schooler beats Edgenuity grading algorithm to get perfect score

A seventh-grade student in the Los Angeles Unified School District received a failing grade on a history assignment graded by Edgenuity's automated scoring algorithm. With help from his mother, a history professor, he reverse-engineered the algorithm by writing a paragraph with relevant keywords and a jumble of words, earning a perfect score. The incident highlights concerns about the accuracy and fairness of automated grading systems in education.

Company involved
Los Angeles Unified School District
AI system involved
Edgenuity

10 source articles · read the reporting →

page 1 of 2Older →