The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Khanmigo for Teachers” · matched on meaning · public reporting

WF-JRM0EH1 Sep 2026

AI video of CM Vijay used to dupe people: Asked users to join WhatsApp group; Pak-linked Facebook accounts ... -…

AI-generated deepfake video of Tamil Nadu CM C. Joseph Vijay impersonated him asking people to contact a WhatsApp number for financial assistance, misleading the public.

1 source article · read the reporting →

Mozilla Foundation animation exposes racial bias in test proctoring app

The Mozilla Foundation commissioned an animated short telling the story of Amaya, a student whose test proctoring software failed to recognise her because of her skin tone. The software's facial recognition system did not detect her presence, illustrating the bias that students of colour face with remote-learning tools. The animation aimed to raise awareness and encourage programmers to address hidden biases in their work.

1 source article · read the reporting →

Fired Teacher Says AI Tainted Review And Arbitration - law360.com

The AI-generated performance evaluation contributed to the teacher's termination.

Company involved
Concord Public Schools

1 source article · read the reporting →

FoloToy's Kumma Bear Gave Dangerous Instructions, Report Warns

A report by Public Interest Research Group found that FoloToy's AI-powered plush bear, Kumma, gave detailed instructions on how to light a match and engaged in sexually explicit conversations. The company later made changes after an internal safety audit. The report also highlighted that Miko's AI robot disclaimed data sharing with third parties. The group urged regulators to enforce existing laws and advised parents to be cautious.

Company involved
FoloToy
AI system involved
Kumma

5 source articles · read the reporting →

New York teacher challenges state evaluation system over flawed rating

Sheri Lederman, a 4th-grade teacher in the Great Neck district, filed a lawsuit against the New York state education department after being rated 'ineffective' on the portion of her evaluation tied to students' test performance, a year after receiving a 'highly effective' score. The lawsuit alleges that the teacher-evaluation system is statistically flawed and lacks a proper appeals process. The education department declined to comment on the litigation.

Company involved
New York state education department

10 source articles · read the reporting →

WF-196C3N1 Feb 2025

Meazure Learning Agrees $1.35m California Bar Exam Class-Action Settlement - Lawyer Monthly

The exam software experienced technical failures that prevented candidates from logging in or completing the California bar exam.

Company involved
Meazure Learning
AI system involved
ProctorU

1 source article · read the reporting →

WF-YZFGT630 Jul 2025

AI-generated tiger video at Barasat madrasa causes panic

A teacher at Ula Kalsara Qadria High Madrasa in Barasat, West Bengal, created an AI-generated video showing three tigers on the campus. The video went viral on social media, causing panic among students and guardians and a sharp drop in attendance. The teacher claimed it was an awareness campaign about AI-generated content, but the madrasa issued a show-cause notice and the video was deleted.

Company involved
Ula Kalsara Qadria High Madrasa

1 source article · read the reporting →

WF-XCCSPW22 Apr 2025

AOS 47 teacher targeted by AI-generated deepfake video

A teacher in the AOS 47 school district in Maine was the victim of a malicious deepfake video created using artificial intelligence. The video, which falsely portrayed the teacher, was circulated online and accessed by a small group of students. The school district reported the account and the post was taken down, and the superintendent expressed full support for the teacher, condemning the digital impersonation.

1 source article · read the reporting →

WF-GWKZP614 Jun 2024

LAUSD shelves AI chatbot after vendor AllHere collapses

Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.

Company involved
Los Angeles Unified School District
AI system involved
Ed

5 source articles · read the reporting →

Parents sue Hingham Public Schools over AI project D grade

The parents of a Hingham High School senior allege the school unfairly punished him for using AI on a social studies project, giving him a D and Saturday detention despite no handbook rule against AI. They say the grade kept him out of the National Honor Society and threatens his applications to top-tier colleges. The family sued Hingham High School administration and the school district in Plymouth County District Court, seeking a grade change and NHS admission. Hingham Public Schools has declined to comment, citing ongoing litigation.

Company involved
Hingham Public Schools

2 source articles · read the reporting →

Derek O'Brien alleges Tek Fog app threatens national security

Derek O'Brien, a Trinamool Congress Rajya Sabha member, wrote to the Parliamentary Standing Committee on Home Affairs alleging that the 'Tek Fog' app is used by people associated with the BJP's IT cell to manipulate social media trends, send spyware messages, and spread fake news. He claims the app can automatically send messages to WhatsApp groups and modify news articles, calling it a threat to national security and privacy.

Company involved
Bharatiya Janata Party
AI system involved
Tek Fog

10 source articles · read the reporting →

WF-HM55RC24 Feb 2012

New York City Department of Education Releases Flawed Teacher Ratings Publicly

In February 2012, the New York City Department of Education publicly released individual Teacher Data Reports rating over 12,000 teachers based on value-added analysis of student test scores. The ratings, originally intended for internal use, were disclosed after a court ruled in favor of media organizations under the Freedom of Information Act. The teachers' union and education experts criticised the data as unreliable due to large margins of error and failure to account for demographic factors, warning that the release would unfairly shame or praise educators. The Department defended the ratings as a useful perspective on teacher effectiveness.

Company involved
New York City Department of Education
AI system involved
Teacher Data Reports

6 source articles · read the reporting →

WF-HT4UHG1 Jan 2011

Houston teachers sue over secret EVAAS evaluation algorithm

Houston Independent School District used the SAS Institute's EVAAS system, a proprietary algorithm, to evaluate teacher performance based on student test scores. The Houston Federation of Teachers and several teachers sued in 2014, alleging the system violated their Fourteenth Amendment procedural due process rights because the algorithm is a trade secret and teachers cannot verify the accuracy of their scores. A federal magistrate judge refused to dismiss the procedural due process claims in May 2017, ruling that teachers must have an opportunity to test the accuracy of the scores that could cost them their jobs.

Company involved
Houston Independent School District
AI system involved
Educational Value-Added Assessment System (EVAAS)

1 source article · read the reporting →

WF-L5NTEZ27 Oct 2014

Teachers find no value in SAS EVAAS system in Southwest School District

A study examined the SAS Education Value-Added Assessment System (EVAAS®) used by the Southwest School District (SSD) to evaluate teacher effectiveness for high-stakes consequences. Teachers reported that the system produced inconsistent results, was biased by student factors, and reduced morale and collaboration. The study found that teachers did not use the data formatively as intended, and unintended consequences included heightened pressure and teaching to the test.

Company involved
Southwest School District (SSD)
AI system involved
SAS Education Value-Added Assessment System (EVAAS®)

10 source articles · read the reporting →

WF-QY8DEQ26 Jun 2025

Hanoi students caught using AI to cheat in graduation exam

Two students in Hanoi used mobile phones to photograph questions from the national high school graduation exam and submitted them to AI apps like StudyX, Gemini, and ChatGPT for answers. Proctors detected the cheating, and the students were suspended. Hanoi police are investigating the incident, which has raised concerns about exam security and integrity. The students face disqualification and possible administrative or criminal penalties.

AI system involved
StudyX, Gemini, ChatGPT

2 source articles · read the reporting →

WF-R36DDB15 May 2023

Texas A&M Professor Uses ChatGPT to Falsely Accuse Students of Cheating

Jared Mumm, an instructor at Texas A&M University–Commerce, used ChatGPT to check if students' writing was AI-generated, leading him to accuse them of using the chatbot. He informed students they would receive an incomplete grade and those deemed guilty would get a zero, causing distress and temporarily withholding one student's diploma. The university investigated and stated that no students failed or were barred from graduating, and the professor is working individually with students to resolve the issue.

Company involved
Texas A&M University–Commerce
AI system involved
ChatGPT

5 source articles · read the reporting →

Hangzhou No. 11 Middle School installs facial recognition system to monitor students

Hangzhou No. 11 Middle School has deployed a smart classroom behaviour management system, developed with Hikvision, that uses facial recognition to take attendance and analyse students' expressions and behaviour. The system alerts teachers when students appear inattentive. The school says it records only behavioural state information, not video, and that it will be installed in all classes. Some people have raised privacy concerns.

Company involved
杭州第十一中学
AI system involved
智慧课堂行为管理系统

10 source articles · read the reporting →

WF-EF57BQ1 Jan 2019

Beijing school uses Hanwang emotion recognition system to monitor student behaviour

Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.

Company involved
Niulanshan First Secondary School
AI system involved
Classroom Care System

10 source articles · read the reporting →

WF-N8YCZF1 Aug 2022

Singapore government's AI therapy bot for teachers triggers gaslighting complaints

In August 2022, the Singapore Ministry of Health and Education launched Mindline at Work, an AI chatbot powered by Wysa, to help stressed teachers. Users reported that the bot gave generic advice like breathing exercises instead of listening, leading to accusations of gaslighting. The teachers felt the tool failed to address the root causes of their burnout, such as heavy workloads and large class sizes. The Ministry of Education did not respond to requests for comment, while Wysa defended the app's approach.

Company involved
Singapore Ministry of Health and Ministry of Education
AI system involved
Mindline at Work

10 source articles · read the reporting →

WF-PZC5LA1 Jan 2020

EEOC sues iTutorGroup for automated rejection of older tutor applicants

The US Equal Employment Opportunity Commission (EEOC) alleges that tutoring provider iTutorGroup programmed its recruitment software automatically to reject female applicants aged 55 or older and male applicants aged 60 or older. More than 200 qualified US-based applicants were denied work in 2020. The EEOC has filed a lawsuit in the Eastern District of New York seeking back pay and damages.

Company involved
iTutorGroup

10 source articles · read the reporting →

WF-PEFP2L8 Sep 2020

Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims

A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.

Company involved
Proctorio
AI system involved
Proctorio

10 source articles · read the reporting →

WF-3NJL6T1 Jan 2016

Buona Scuola algorithm mistakenly assigned thousands of teachers in Italy

In 2016, the Buona Scuola algorithm, used by the Italian Ministry of Education, mistakenly assigned thousands of teachers to wrong professional destinations based on mobility rankings. The system was later discontinued. The incident is reported in the Automating Society Report 2020.

Company involved
Italian Ministry of Education
AI system involved
Buona Scuola algorithm

10 source articles · read the reporting →

WF-ARIFZJ13 Jul 2011

DCPS used allegedly false test scores in teacher value-added evaluations

The District of Columbia Public Schools used student test scores from schools under investigation for cheating in value-added calculations for teacher evaluations. More than 200 teachers were terminated based on these evaluations. Teachers can appeal their ratings to the chancellor, but decisions will not be made before the next school year. The school system removes affected scores only when cheating is confirmed.

Company involved
District of Columbia Public Schools
AI system involved
value-added model

10 source articles · read the reporting →

Mazaheri v Law Society of Ontario (Law Society Tribunal (ON)): AI-hallucinated content in court filing, Adverse Costs Order

AI generated fabricated legal citations in a court filing by Shahryar Mazaheri.

1 source article · read the reporting →

page 1 of 2Older →