The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Panorama Student Success” · matched on meaning · public reporting

WF-L5NTEZ27 Oct 2014

Teachers find no value in SAS EVAAS system in Southwest School District

A study examined the SAS Education Value-Added Assessment System (EVAAS®) used by the Southwest School District (SSD) to evaluate teacher effectiveness for high-stakes consequences. Teachers reported that the system produced inconsistent results, was biased by student factors, and reduced morale and collaboration. The study found that teachers did not use the data formatively as intended, and unintended consequences included heightened pressure and teaching to the test.

Company involved
Southwest School District (SSD)
AI system involved
SAS Education Value-Added Assessment System (EVAAS®)

10 source articles · read the reporting →

WF-Q37MEU20 Feb 2025

Police investigate AI deepfake images of students at Gladstone Park Secondary College

Sexually explicit AI-generated images of female students at Gladstone Park Secondary College in Melbourne were created and circulated online. Victoria Police are investigating, with as many as 60 students potentially impacted. Two year 11 students have been suspended, and the school is providing wellbeing support. The incident has been described as 'disturbing' and 'despicable' by police.

Company involved
Gladstone Park Secondary College

1 source article · read the reporting →

WF-QY8DEQ26 Jun 2025

Hanoi students caught using AI to cheat in graduation exam

Two students in Hanoi used mobile phones to photograph questions from the national high school graduation exam and submitted them to AI apps like StudyX, Gemini, and ChatGPT for answers. Proctors detected the cheating, and the students were suspended. Hanoi police are investigating the incident, which has raised concerns about exam security and integrity. The students face disqualification and possible administrative or criminal penalties.

AI system involved
StudyX, Gemini, ChatGPT

2 source articles · read the reporting →

WF-R36DDB15 May 2023

Texas A&M Professor Uses ChatGPT to Falsely Accuse Students of Cheating

Jared Mumm, an instructor at Texas A&M University–Commerce, used ChatGPT to check if students' writing was AI-generated, leading him to accuse them of using the chatbot. He informed students they would receive an incomplete grade and those deemed guilty would get a zero, causing distress and temporarily withholding one student's diploma. The university investigated and stated that no students failed or were barred from graduating, and the professor is working individually with students to resolve the issue.

Company involved
Texas A&M University–Commerce
AI system involved
ChatGPT

5 source articles · read the reporting →

WF-FB00CQ1 Dec 2017

Australian education ministers scrap NAPLAN robot marking

The Education Council decided not to use automated essay scoring for NAPLAN writing tests, dropping a proposal by ACARA to have computers mark English tasks. Teachers' unions had campaigned against the plan, and an academic warned that the software would reward verbose gibberish and could not assess creativity. The decision was made in December 2017 and announced in January 2018.

Company involved
Australian Curriculum, Assessment and Reporting Authority (ACARA)

10 source articles · read the reporting →

Hangzhou No. 11 Middle School installs facial recognition system to monitor students

Hangzhou No. 11 Middle School has deployed a smart classroom behaviour management system, developed with Hikvision, that uses facial recognition to take attendance and analyse students' expressions and behaviour. The system alerts teachers when students appear inattentive. The school says it records only behavioural state information, not video, and that it will be installed in all classes. Some people have raised privacy concerns.

Company involved
杭州第十一中学
AI system involved
智慧课堂行为管理系统

10 source articles · read the reporting →

WF-F7GEG019 Feb 2020

UCLA abandons facial recognition plans after test reveals racial bias

UCLA had proposed using facial recognition surveillance on campus, scanning faces and checking them against a mugshot database. Fight for the Future tested Amazon Rekognition on photos of UCLA sports teams and faculty, finding that the software falsely matched 58 individuals, mostly people of color, with mugshot photos. Following community backlash and the test results, UCLA's administration announced it was abandoning the plan.

Company involved
UCLA
AI system involved
Rekognition

10 source articles · read the reporting →

WF-SASGFE1 Sep 2018

Anderstorp gymnasium trials facial recognition to register student attendance

Anderstorp gymnasium in Skellefteå, Sweden, used a facial recognition system for a few weeks in autumn 2018 to automatically register students' attendance when they entered a classroom. The system, made by an unnamed manufacturer, replaced teachers' manual attendance records for one class. Pupils were mostly satisfied, and the school's principal described the technology as safe. Skellefteå municipality and the manufacturer are discussing a possible continuation, with the manufacturer recommending consultation with Datainspektionen before scaling up.

Company involved
Skellefteå kommun

10 source articles · read the reporting →

WF-EF57BQ1 Jan 2019

Beijing school uses Hanwang emotion recognition system to monitor student behaviour

Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.

Company involved
Niulanshan First Secondary School
AI system involved
Classroom Care System

10 source articles · read the reporting →

Chinese university deploys facial recognition for attendance monitoring

A university in eastern China has installed a facial recognition system at its entrance and in two classrooms to monitor student attendance and behaviour. The system automatically captures students' faces without their cooperation. The pilot project is intended to improve attendance rates. No specific incidents of harm have been reported.

10 source articles · read the reporting →

WF-XQL7UV26 Feb 2026

Lake Zurich High School students used AI to generate explicit images of female classmates

In February 2026, students at Lake Zurich High School used artificial intelligence to generate sexually explicit images of female classmates without their consent. The school district acknowledged the incident and notified police, who are investigating. More than 40 girls from fifth grade to high school were reportedly affected. The school provided support and issued disciplinary consequences, while the police investigation continues.

Company involved
Lake Zurich Community Unit School District 95

1 source article · read the reporting →

WF-TNB7Q615 Oct 2024

NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure

The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.

Company involved
NSW Education Standards Authority
AI system involved
ChatGPT and Dall-E 2

6 source articles · read the reporting →

WF-L1LKDO1 Mar 2021

China's vocational school students exploited as data annotators for AI

Vocational schools in China force students to work as data annotators for AI companies, paying subminimum wages and taking commissions. Students like Lucy in Shandong spent months labeling data for autonomous driving and content moderation systems, with little learning or career advancement. The practice continues despite new regulations.

2 source articles · read the reporting →

WF-TRGJYR4 Sep 2020

University of Miami used surveillance to track student protesters

The University of Miami used video surveillance and possibly facial recognition technology to identify students who participated in a 'die-in' protest on September 4, 2020. The students were then summoned to a meeting with the dean of students. The university denied using facial recognition, but the police department's resume mentions its use. Students reported feeling anxious and watched.

Company involved
University of Miami

9 source articles · read the reporting →

WF-8VKXFD28 Jun 2020

UBC students raise concerns over Proctorio's privacy breach and discrimination

The University of British Columbia (UBC) uses Proctorio, an algorithmic test proctoring software, for remote exams. In June 2020, a UBC student reported an issue with Proctorio, and the company's CEO released the student's support chat logs, sparking privacy concerns. The AMS of UBC published an open letter alleging that Proctorio discriminates against students of colour, those with disabilities, and other groups by flagging 'abnormal' behaviours and denying access. The letter calls on UBC to end its contract with Proctorio and conduct an external audit.

Company involved
University of British Columbia
AI system involved
Proctorio

10 source articles · read the reporting →

WF-W8MY6X1 Sep 2020

Middle schooler beats Edgenuity grading algorithm to get perfect score

A seventh-grade student in the Los Angeles Unified School District received a failing grade on a history assignment graded by Edgenuity's automated scoring algorithm. With help from his mother, a history professor, he reverse-engineered the algorithm by writing a paragraph with relevant keywords and a jumble of words, earning a perfect score. The incident highlights concerns about the accuracy and fairness of automated grading systems in education.

Company involved
Los Angeles Unified School District
AI system involved
Edgenuity

10 source articles · read the reporting →

WF-XH2W9I1 Sep 2020

Proctortrack data breach exposed student data from online proctoring

Proctortrack, an online proctoring service used by universities, suffered a data breach in September 2020 when its source code was leaked online. An analysis by Consumer Reports found that the code contained hard-coded passwords and exposed the names and email addresses of over 150 students. The company acknowledged the leak but said no harm resulted. Students had been required to use the software, which performed facial recognition and recorded video during exams.

Company involved
Proctortrack
AI system involved
Proctortrack

10 source articles · read the reporting →

WF-SD7T9128 Sep 2020

Student flagged by ProctorU for reading aloud during exam

A college student, Dana Jo, was flagged by ProctorU test proctoring software for talking during an exam, which she says was reading a question aloud. Her professor initially gave her a zero and placed an academic infraction on her record, jeopardizing her scholarships. After reviewing a video recording, the professor apologized, reinstated her grade, and removed the infraction. ProctorU's CEO stated that the incident highlights the importance of video recordings for review.

Company involved
University (not named)
AI system involved
ProctorU

5 source articles · read the reporting →

Wisconsin’s dropout prediction algorithm labels students high risk with racial bias

Wisconsin’s Dropout Early Warning System (DEWS) uses machine learning to predict middle school students' likelihood of graduating on time, relying on factors including race and income. The Markup found the algorithm frequently mislabels students, with a higher false alarm rate for Black and Hispanic students. The Wisconsin Department of Public Instruction has not informed schools of the racial disparities and continues to use the system.

Company involved
Wisconsin Department of Public Instruction
AI system involved
Dropout Early Warning System (DEWS)

10 source articles · read the reporting →

WF-53YZFN1 Jul 2023

Nevada's AI grad score model cuts funding for low-income students

Nevada replaced its income-based school funding formula with a machine learning model developed by Infinite Campus that generates a 'grad score' for each student. The model reduced the number of students eligible for supplemental funding from 288,000 to 63,000, disproportionately affecting low-income students. Critics argue the model lacks transparency and de-emphasizes economic status, potentially leaving many high-poverty schools underfunded.

Company involved
Nevada Department of Education
AI system involved
Grad score model

7 source articles · read the reporting →

Facial recognition trialled in Australian schools to mark attendance

Five Australian schools are trialling a facial recognition system from LoopLearn to automate student attendance. The system scans students' faces and sends attendance data to an app. Privacy experts have raised concerns about data security and surveillance. The Victorian government previously tried to stop the trial due to privacy risks.

Company involved
Clarendon College
AI system involved
LoopLearn

10 source articles · read the reporting →

Cleveland State University's room scan requirement ruled unconstitutional

A federal judge ruled that Cleveland State University's requirement for a student to undergo a 360-degree room scan before an online exam was an unreasonable search under the Fourth Amendment. The student, enrolled at the public university, was told shortly before the exam that he would need to scan his private space. The court found that the university's justifications did not outweigh the privacy protections of the home. No final judgment or injunction has been issued yet.

Company involved
Cleveland State University

10 source articles · read the reporting →

WF-701YEA11 Mar 2021

UW-Madison disables Honorlock after skin tone recognition failure

The University of Wisconsin-Madison disabled the exam pause feature of its Honorlock anti-cheating software in March 2021 after three students complained that the software failed to recognize their darker skin tones and paused their exams. The software, used since online classes began, automatically pauses exams when it cannot detect facial features. Honorlock denied the issue was related to skin tone, attributing it to students looking away from their webcams. The university responded by disabling the feature.

Company involved
University of Wisconsin-Madison
AI system involved
Honorlock

10 source articles · read the reporting →

Dartmouth Medical School charges 17 students with cheating based on tracking system.

Dartmouth College's Geisel School of Medicine charged 17 students with cheating on remote exams during the pandemic. The charges were based on secret tracking of student activity on the learning management system. Critics say the system is prone to errors and inappropriate for monitoring students.

Company involved
Dartmouth College Geisel School of Medicine

10 source articles · read the reporting →

← Newerpage 2 of 3Older →