The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Panorama Education” · matched on meaning · public reporting

WF-FB00CQ1 Dec 2017

Australian education ministers scrap NAPLAN robot marking

The Education Council decided not to use automated essay scoring for NAPLAN writing tests, dropping a proposal by ACARA to have computers mark English tasks. Teachers' unions had campaigned against the plan, and an academic warned that the software would reward verbose gibberish and could not assess creativity. The decision was made in December 2017 and announced in January 2018.

Company involved
Australian Curriculum, Assessment and Reporting Authority (ACARA)

10 source articles · read the reporting →

WF-XBXRUJ18 Apr 2022

Intel and Class Technologies face criticism over emotion-detecting AI for students

Intel partnered with Class Technologies to use an AI system that analyses student emotions during Zoom classes to provide insights to teachers. Critics, including educator Todd Richmond, argued that facial expressions are not reliable indicators of internal states and that the system amounts to pseudoscience. The article reports these criticisms as allegations, not as proven fact. No specific incident of harm or regulatory action is reported.

Company involved
Intel
AI system involved
Class Technologies face-reading AI

10 source articles · read the reporting →

Hangzhou No. 11 Middle School installs facial recognition system to monitor students

Hangzhou No. 11 Middle School has deployed a smart classroom behaviour management system, developed with Hikvision, that uses facial recognition to take attendance and analyse students' expressions and behaviour. The system alerts teachers when students appear inattentive. The school says it records only behavioural state information, not video, and that it will be installed in all classes. Some people have raised privacy concerns.

Company involved
杭州第十一中学
AI system involved
智慧课堂行为管理系统

10 source articles · read the reporting →

WF-9KY8EL19 Oct 2019

Outback Steakhouse franchise tests Presto Vision to monitor staff and guests

Evergreen Restaurant Group, a franchisee of Outback Steakhouse, has begun testing Presto Vision, a computer vision system that analyses surveillance camera footage to track employee performance and guest behaviour. The system compiles metrics on service, wait times, and customer turnover, which managers receive by email. Employees say they were not informed about the technology, and researchers have raised concerns about workplace stress, job losses, and data sharing with parent companies.

Company involved
Evergreen Restaurant Group
AI system involved
Presto Vision

8 source articles · read the reporting →

WF-SASGFE1 Sep 2018

Anderstorp gymnasium trials facial recognition to register student attendance

Anderstorp gymnasium in Skellefteå, Sweden, used a facial recognition system for a few weeks in autumn 2018 to automatically register students' attendance when they entered a classroom. The system, made by an unnamed manufacturer, replaced teachers' manual attendance records for one class. Pupils were mostly satisfied, and the school's principal described the technology as safe. Skellefteå municipality and the manufacturer are discussing a possible continuation, with the manufacturer recommending consultation with Datainspektionen before scaling up.

Company involved
Skellefteå kommun

10 source articles · read the reporting →

WF-EF57BQ1 Jan 2019

Beijing school uses Hanwang emotion recognition system to monitor student behaviour

Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.

Company involved
Niulanshan First Secondary School
AI system involved
Classroom Care System

10 source articles · read the reporting →

WF-XQL7UV26 Feb 2026

Lake Zurich High School students used AI to generate explicit images of female classmates

In February 2026, students at Lake Zurich High School used artificial intelligence to generate sexually explicit images of female classmates without their consent. The school district acknowledged the incident and notified police, who are investigating. More than 40 girls from fifth grade to high school were reportedly affected. The school provided support and issued disciplinary consequences, while the police investigation continues.

Company involved
Lake Zurich Community Unit School District 95

1 source article · read the reporting →

WF-TNB7Q615 Oct 2024

NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure

The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.

Company involved
NSW Education Standards Authority
AI system involved
ChatGPT and Dall-E 2

6 source articles · read the reporting →

UK councils use Covid OneView AI to harvest personal data for risk scoring

UK local authorities are using a system called Covid OneView, developed by data analytics firm Xantura, to harvest millions of personal details from council records. The system uses predictive analytics and AI to assign risk scores to households and individuals, aiming to identify those vulnerable to Covid or likely to break lockdown rules. Privacy campaigners and MPs have criticised the lack of transparency and the extent of data collection, which includes sensitive information such as debt levels, living arrangements, and even notes on unfaithful sex. Xantura and Barking and Dagenham Council have defended the system as compliant with data protection rules and focused on providing support.

Company involved
UK local authorities
AI system involved
Covid OneView

6 source articles · read the reporting →

WF-8VKXFD28 Jun 2020

UBC students raise concerns over Proctorio's privacy breach and discrimination

The University of British Columbia (UBC) uses Proctorio, an algorithmic test proctoring software, for remote exams. In June 2020, a UBC student reported an issue with Proctorio, and the company's CEO released the student's support chat logs, sparking privacy concerns. The AMS of UBC published an open letter alleging that Proctorio discriminates against students of colour, those with disabilities, and other groups by flagging 'abnormal' behaviours and denying access. The letter calls on UBC to end its contract with Proctorio and conduct an external audit.

Company involved
University of British Columbia
AI system involved
Proctorio

10 source articles · read the reporting →

WF-W8MY6X1 Sep 2020

Middle schooler beats Edgenuity grading algorithm to get perfect score

A seventh-grade student in the Los Angeles Unified School District received a failing grade on a history assignment graded by Edgenuity's automated scoring algorithm. With help from his mother, a history professor, he reverse-engineered the algorithm by writing a paragraph with relevant keywords and a jumble of words, earning a perfect score. The incident highlights concerns about the accuracy and fairness of automated grading systems in education.

Company involved
Los Angeles Unified School District
AI system involved
Edgenuity

10 source articles · read the reporting →

WF-XH2W9I1 Sep 2020

Proctortrack data breach exposed student data from online proctoring

Proctortrack, an online proctoring service used by universities, suffered a data breach in September 2020 when its source code was leaked online. An analysis by Consumer Reports found that the code contained hard-coded passwords and exposed the names and email addresses of over 150 students. The company acknowledged the leak but said no harm resulted. Students had been required to use the software, which performed facial recognition and recorded video during exams.

Company involved
Proctortrack
AI system involved
Proctortrack

10 source articles · read the reporting →

WF-PEFP2L8 Sep 2020

Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims

A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.

Company involved
Proctorio
AI system involved
Proctorio

10 source articles · read the reporting →

WF-SD7T9128 Sep 2020

Student flagged by ProctorU for reading aloud during exam

A college student, Dana Jo, was flagged by ProctorU test proctoring software for talking during an exam, which she says was reading a question aloud. Her professor initially gave her a zero and placed an academic infraction on her record, jeopardizing her scholarships. After reviewing a video recording, the professor apologized, reinstated her grade, and removed the infraction. ProctorU's CEO stated that the incident highlights the importance of video recordings for review.

Company involved
University (not named)
AI system involved
ProctorU

5 source articles · read the reporting →

Clearview AI tested facial recognition surveillance cameras with UFT and Rudin

Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.

Company involved
Clearview AI
AI system involved
Insight Camera

9 source articles · read the reporting →

Wisconsin’s dropout prediction algorithm labels students high risk with racial bias

Wisconsin’s Dropout Early Warning System (DEWS) uses machine learning to predict middle school students' likelihood of graduating on time, relying on factors including race and income. The Markup found the algorithm frequently mislabels students, with a higher false alarm rate for Black and Hispanic students. The Wisconsin Department of Public Instruction has not informed schools of the racial disparities and continues to use the system.

Company involved
Wisconsin Department of Public Instruction
AI system involved
Dropout Early Warning System (DEWS)

10 source articles · read the reporting →

WF-53YZFN1 Jul 2023

Nevada's AI grad score model cuts funding for low-income students

Nevada replaced its income-based school funding formula with a machine learning model developed by Infinite Campus that generates a 'grad score' for each student. The model reduced the number of students eligible for supplemental funding from 288,000 to 63,000, disproportionately affecting low-income students. Critics argue the model lacks transparency and de-emphasizes economic status, potentially leaving many high-poverty schools underfunded.

Company involved
Nevada Department of Education
AI system involved
Grad score model

7 source articles · read the reporting →

Facial recognition trialled in Australian schools to mark attendance

Five Australian schools are trialling a facial recognition system from LoopLearn to automate student attendance. The system scans students' faces and sends attendance data to an app. Privacy experts have raised concerns about data security and surveillance. The Victorian government previously tried to stop the trial due to privacy risks.

Company involved
Clarendon College
AI system involved
LoopLearn

10 source articles · read the reporting →

WF-701YEA11 Mar 2021

UW-Madison disables Honorlock after skin tone recognition failure

The University of Wisconsin-Madison disabled the exam pause feature of its Honorlock anti-cheating software in March 2021 after three students complained that the software failed to recognize their darker skin tones and paused their exams. The software, used since online classes began, automatically pauses exams when it cannot detect facial features. Honorlock denied the issue was related to skin tone, attributing it to students looking away from their webcams. The university responded by disabling the feature.

Company involved
University of Wisconsin-Madison
AI system involved
Honorlock

10 source articles · read the reporting →

WF-3NJL6T1 Jan 2016

Buona Scuola algorithm mistakenly assigned thousands of teachers in Italy

In 2016, the Buona Scuola algorithm, used by the Italian Ministry of Education, mistakenly assigned thousands of teachers to wrong professional destinations based on mobility rankings. The system was later discontinued. The incident is reported in the Automating Society Report 2020.

Company involved
Italian Ministry of Education
AI system involved
Buona Scuola algorithm

10 source articles · read the reporting →

WF-ARIFZJ13 Jul 2011

DCPS used allegedly false test scores in teacher value-added evaluations

The District of Columbia Public Schools used student test scores from schools under investigation for cheating in value-added calculations for teacher evaluations. More than 200 teachers were terminated based on these evaluations. Teachers can appeal their ratings to the chancellor, but decisions will not be made before the next school year. The school system removes affected scores only when cheating is confirmed.

Company involved
District of Columbia Public Schools
AI system involved
value-added model

10 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

WF-EA6R453 Jan 2023

New York City Department of Education blocks ChatGPT on school devices

The New York City Department of Education blocked access to the AI chatbot ChatGPT on school devices and networks, citing concerns about negative impacts on student learning and the safety and accuracy of content. The ban applies to all students and teachers on education department devices and internet networks. Individual schools can still request access for studying the technology. The move is the nation's largest school system's response to the arrival of ChatGPT.

Company involved
New York City Department of Education
AI system involved
ChatGPT

9 source articles · read the reporting →

WF-TT1WEC30 Sep 2020

UIUC students petition to stop Proctorio exam proctoring over privacy concerns

A petition at the University of Illinois at Urbana-Champaign (UIUC) alleges that Proctorio, an online exam proctoring system, violates student privacy by accessing websites, downloads, screen content, and app settings. The petition claims the terms of service allow monitoring by 'any other means necessary', which students find unsettling. The petition, created on September 30, 2020, gathered 1,087 supporters but does not report any specific incident of harm. It calls on UIUC to discontinue use of Proctorio in favour of alternatives.

Company involved
UIUC
AI system involved
Proctorio

9 source articles · read the reporting →

← Newerpage 2 of 3Older →