The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Respondus 4” · matched on meaning · public reporting

WF-R36DDB15 May 2023

Texas A&M Professor Uses ChatGPT to Falsely Accuse Students of Cheating

Jared Mumm, an instructor at Texas A&M University–Commerce, used ChatGPT to check if students' writing was AI-generated, leading him to accuse them of using the chatbot. He informed students they would receive an incomplete grade and those deemed guilty would get a zero, causing distress and temporarily withholding one student's diploma. The university investigated and stated that no students failed or were barred from graduating, and the professor is working individually with students to resolve the issue.

Company involved
Texas A&M University–Commerce
AI system involved
ChatGPT

5 source articles · read the reporting →

WF-FB00CQ1 Dec 2017

Australian education ministers scrap NAPLAN robot marking

The Education Council decided not to use automated essay scoring for NAPLAN writing tests, dropping a proposal by ACARA to have computers mark English tasks. Teachers' unions had campaigned against the plan, and an academic warned that the software would reward verbose gibberish and could not assess creativity. The decision was made in December 2017 and announced in January 2018.

Company involved
Australian Curriculum, Assessment and Reporting Authority (ACARA)

10 source articles · read the reporting →

WF-VFS58P1 Aug 2025

Microsoft Recall still captures credit cards and passwords despite filter

The Register tested Microsoft Recall's sensitive information filter and found it frequently fails to block credit card numbers, passwords, and other personal data. The AI-powered screenshot tool, which is enabled by default on some new PCs, could expose users to identity theft if an attacker gains access. Microsoft declined to comment but has previously acknowledged the filter is not perfect and promised improvements. Privacy advocates warn that vulnerable users, such as domestic violence victims, could be particularly at risk.

Company involved
Microsoft
AI system involved
Recall

2 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

WF-961A0L1 Dec 2018

Educational Testing Service's E-rater algorithm biases essay scores against minority students

The Educational Testing Service's E-rater algorithm, used to grade essays on the GRE and other standardized tests, has been found to systematically give higher scores to students from mainland China and lower scores to African American students compared to human graders. The bias stems from the algorithm's reliance on surface-level metrics like vocabulary and sentence length, which disadvantage certain groups. Despite studies dating back to 1999, the bias persists, and in many states, only a small percentage of essays are reviewed by humans.

Company involved
Educational Testing Service
AI system involved
E-rater

10 source articles · read the reporting →

WF-8VKXFD28 Jun 2020

UBC students raise concerns over Proctorio's privacy breach and discrimination

The University of British Columbia (UBC) uses Proctorio, an algorithmic test proctoring software, for remote exams. In June 2020, a UBC student reported an issue with Proctorio, and the company's CEO released the student's support chat logs, sparking privacy concerns. The AMS of UBC published an open letter alleging that Proctorio discriminates against students of colour, those with disabilities, and other groups by flagging 'abnormal' behaviours and denying access. The letter calls on UBC to end its contract with Proctorio and conduct an external audit.

Company involved
University of British Columbia
AI system involved
Proctorio

10 source articles · read the reporting →

WF-W8MY6X1 Sep 2020

Middle schooler beats Edgenuity grading algorithm to get perfect score

A seventh-grade student in the Los Angeles Unified School District received a failing grade on a history assignment graded by Edgenuity's automated scoring algorithm. With help from his mother, a history professor, he reverse-engineered the algorithm by writing a paragraph with relevant keywords and a jumble of words, earning a perfect score. The incident highlights concerns about the accuracy and fairness of automated grading systems in education.

Company involved
Los Angeles Unified School District
AI system involved
Edgenuity

10 source articles · read the reporting →

WF-JVU6VY1 Mar 2020

ProctorU threatens UC Santa Barbara faculty over privacy criticism

ProctorU, an online proctoring service, sent a legal threat letter to the University of California Santa Barbara faculty association after the association expressed concerns about ProctorU's data privacy policies. The letter, from ProctorU's lawyer, invoked defamation, copyright, and trademark claims, and was copied to state and federal prosecutors. The faculty association had asked the university to reconsider its relationship with ProctorU due to concerns about student data sharing.

Company involved
ProctorU
AI system involved
ProctorU

10 source articles · read the reporting →

WF-IL3CFJ1 Jul 2020

ProctorU data breach exposes 444,000 user records

ProctorU, an online exam proctoring service, confirmed a data breach after a threat actor leaked a database of user records on a hacker forum. The database contained email addresses, names, addresses, phone numbers, and hashed passwords for approximately 444,000 users, including students from universities such as UCLA, Princeton, and Harvard, as well as U.S. military members. ProctorU stated that the breach involved records from 2014 and that they are investigating the incident.

Company involved
ProctorU
AI system involved
ProctorU

8 source articles · read the reporting →

WF-XH2W9I1 Sep 2020

Proctortrack data breach exposed student data from online proctoring

Proctortrack, an online proctoring service used by universities, suffered a data breach in September 2020 when its source code was leaked online. An analysis by Consumer Reports found that the code contained hard-coded passwords and exposed the names and email addresses of over 150 students. The company acknowledged the leak but said no harm resulted. Students had been required to use the software, which performed facial recognition and recorded video during exams.

Company involved
Proctortrack
AI system involved
Proctortrack

10 source articles · read the reporting →

WF-PEFP2L8 Sep 2020

Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims

A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.

Company involved
Proctorio
AI system involved
Proctorio

10 source articles · read the reporting →

WF-II25VQ28 Jul 2020

ExamSoft failure during Michigan Bar Exam

On July 28, 2020, ExamSoft's software platform failed during the Michigan Bar Exam, preventing some test takers from completing the exam. ExamSoft posted a statement on X (formerly Twitter) with the hashtag #MichiganBarExam, but critics noted the company deleted and reposted the statement multiple times, allegedly to hide negative comments. The incident affected a group of examinees and caused disruption to their ability to take the exam.

Company involved
ExamSoft
AI system involved
ExamSoft platform

10 source articles · read the reporting →

WF-SD7T9128 Sep 2020

Student flagged by ProctorU for reading aloud during exam

A college student, Dana Jo, was flagged by ProctorU test proctoring software for talking during an exam, which she says was reading a question aloud. Her professor initially gave her a zero and placed an academic infraction on her record, jeopardizing her scholarships. After reviewing a video recording, the professor apologized, reinstated her grade, and removed the infraction. ProctorU's CEO stated that the incident highlights the importance of video recordings for review.

Company involved
University (not named)
AI system involved
ProctorU

5 source articles · read the reporting →

WF-OH4XSX22 Mar 2023

ChatGPT-4 generates false accusations and quotes about law professors

OpenAI's ChatGPT-4 generated false accusations and fabricated quotes about law professors when asked about scandals and crimes involving law professors. The system produced entirely made-up newspaper citations and quotes, falsely alleging misconduct such as harassment and tax fraud. The article reports that these hallucinations could mislead users who trust the generated quotes. The author corrected an earlier error attributing similar results to ChatGPT-4 instead of ChatGPT-3.5, but confirmed that ChatGPT-4 also produces such false outputs.

Company involved
OpenAI
AI system involved
ChatGPT-4

10 source articles · read the reporting →

WF-PMLNUT17 Sep 2020

California bar exam facial recognition system fails to verify Arab-American student's identity

Ahmed Alamri, an Arab-American law student, was unable to register for the practice California bar exam because ExamSoft's facial recognition system repeatedly failed to recognize his face, citing poor lighting. Alamri attempted to verify his identity over 75 times in different rooms and lighting conditions without success. He and other students filed an emergency petition with the California Supreme Court, alleging that the system discriminates against people of color. The incident highlights concerns about bias in facial recognition technology used for exam proctoring.

Company involved
California State Bar
AI system involved
ExamSoft

10 source articles · read the reporting →

WF-2N0W571 Mar 2023

NewsGuard finds ChatGPT-4 generates all 100 false narratives in test

In March 2023, NewsGuard tested ChatGPT-4 by prompting it with 100 false narratives from its database. The chatbot generated all 100 false narratives, often without disclaimers, and produced more persuasive misinformation than its predecessor ChatGPT-3.5. NewsGuard reported that OpenAI had not fixed the flaw before releasing the tool, and the company did not respond to requests for comment.

Company involved
OpenAI
AI system involved
ChatGPT-4

3 source articles · read the reporting →

Cleveland State University's room scan requirement ruled unconstitutional

A federal judge ruled that Cleveland State University's requirement for a student to undergo a 360-degree room scan before an online exam was an unreasonable search under the Fourth Amendment. The student, enrolled at the public university, was told shortly before the exam that he would need to scan his private space. The court found that the university's justifications did not outweigh the privacy protections of the home. No final judgment or injunction has been issued yet.

Company involved
Cleveland State University

10 source articles · read the reporting →

WF-701YEA11 Mar 2021

UW-Madison disables Honorlock after skin tone recognition failure

The University of Wisconsin-Madison disabled the exam pause feature of its Honorlock anti-cheating software in March 2021 after three students complained that the software failed to recognize their darker skin tones and paused their exams. The software, used since online classes began, automatically pauses exams when it cannot detect facial features. Honorlock denied the issue was related to skin tone, attributing it to students looking away from their webcams. The university responded by disabling the feature.

Company involved
University of Wisconsin-Madison
AI system involved
Honorlock

10 source articles · read the reporting →

Dartmouth Medical School charges 17 students with cheating based on tracking system.

Dartmouth College's Geisel School of Medicine charged 17 students with cheating on remote exams during the pandemic. The charges were based on secret tracking of student activity on the learning management system. Critics say the system is prone to errors and inappropriate for monitoring students.

Company involved
Dartmouth College Geisel School of Medicine

10 source articles · read the reporting →

WF-LKR1LN18 Aug 2026

Joann LeDoux v. Outliers, Inc. (2) (W.D. Washington): AI-hallucinated content in court filing, Expert Brief excluded/struck

The AI-generated hallucinated citations in an expert report led to the exclusion of the expert and dismissal of the plaintiff's case.

1 source article · read the reporting →

WF-4RKE3V1 May 2016

Danish students publish OkCupid user data, DPA investigates

Two Danish students scraped and published data on 70,000 OkCupid users, including sensitive sexual preferences and religious views, without anonymisation. The dataset was removed after OkCupid filed a copyright notice. The Danish Data Protection Authority (Datatilsynet) has launched an investigation into the incident.

10 source articles · read the reporting →

WF-YWUJN81 Oct 2024

Company fires HR team after ATS auto-rejects manager's CV due to filtering error

A company's applicant tracking system (ATS) auto-rejected qualified candidates' resumes for three months because it was filtering for the outdated framework AngularJS instead of the required Angular framework. The manager discovered the flaw by submitting his own CV under a pseudonym and found it was rejected within seconds. After the manager reported the issue to upper management, the company investigated and dismissed half of its HR team. No legal action or regulatory involvement is reported.

4 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

Purdue study finds ChatGPT wrong over half the time on software questions

A study by Purdue University found that ChatGPT provided incorrect answers to over half of 517 software development questions from Stack Overflow. Despite the errors, 34% of users preferred ChatGPT's answers over human responses. The study warns that relying on ChatGPT for coding could jeopardize programmers' professional reputations.

Company involved
OpenAI
AI system involved
ChatGPT

9 source articles · read the reporting →

← Newerpage 2 of 3Older →