Udemy automatically opts instructors into AI training with limited opt-out window
Udemy automatically opted instructors into having their classes used to train its generative AI program. Instructors were given a three-week window to opt out, which has now passed, leaving some unable to remove their content. Katie Stegs, an instructor, said she only found out via an email welcoming her to the program and found the opt-out option greyed out. Udemy defended the policy, citing the technical difficulty of removing data from AI models, while some instructors have left the platform in protest.
- Company involved
- Udemy
- AI system involved
- Generative AI Program (GenAI Program)
6 source articles · read the reporting →
Mozilla Foundation animation exposes racial bias in test proctoring app
The Mozilla Foundation commissioned an animated short telling the story of Amaya, a student whose test proctoring software failed to recognise her because of her skin tone. The software's facial recognition system did not detect her presence, illustrating the bias that students of colour face with remote-learning tools. The animation aimed to raise awareness and encourage programmers to address hidden biases in their work.
1 source article · read the reporting →
Furman University student caught using ChatGPT to write essay
A student at Furman University allegedly used OpenAI's ChatGPT to generate an essay for an upper-level philosophy class. Professor Darren Hick detected the AI-generated text using the GPTZero detection tool. The incident highlights growing concerns about AI-assisted cheating in schools, with some districts like Los Angeles Unified blocking the chatbot.
- Company involved
- Furman University
- AI system involved
- ChatGPT
10 source articles · read the reporting →
University of Illinois Ends Proctorio Contract Over Accessibility Concerns
The University of Illinois at Urbana-Champaign announced it will not renew its emergency contract with Proctorio, an online proctoring software, citing significant accessibility, privacy, and equity concerns. Students reported that the AI system unfairly flagged individuals with disabilities, nonwhite students, and those wearing headscarves as suspicious during exams. The decision follows student petitions and campaigns against the software, which they described as invasive spyware. The university is exploring alternative assessment methods.
- Company involved
- University of Illinois at Urbana-Champaign
- AI system involved
- Proctorio
6 source articles · read the reporting →
Sydney students resit NAPLAN after predictive text glitch
Year 5 students at Waverley College and Kambala in Sydney were required to resit their NAPLAN writing exams after a technical glitch enabled Apple's predictive text and spellcheck features during the test. The issue was discovered by a teacher and students, and the schools reported it to NESA and ACARA. The students were given a new prompt and completed the test the following Monday. An ACARA spokesman stated the problem was not widespread, with over 880,000 tests submitted successfully.
- Company involved
- ACARA
- AI system involved
- NAPLAN
2 source articles · read the reporting →
University of Toronto exam monitoring software disadvantages BIPOC students
The University of Toronto continued using ProctorU and Examity exam monitoring software despite reports that the facial recognition technology fails to identify BIPOC students, causing stress and delays. Students like Maame Adjoa experienced the AI system being unable to verify their identity, requiring manual intervention. The university acknowledged the equity concerns but has not banned the software, while ProctorU stated that human proctors make final decisions. The issue has drawn criticism from US senators and researchers who highlight built-in bias in AI facial recognition.
- Company involved
- University of Toronto
- AI system involved
- ProctorU, Examity
1 source article · read the reporting →
LLMjacking Attack Leverages Stolen Credentials to Exploit Cloud LLMs
The Sysdig Threat Research Team observed an attack where stolen cloud credentials were used to access cloud-hosted large language model services. The attackers targeted a vulnerable Laravel system to obtain credentials, then used them to invoke models like Anthropic Claude on AWS Bedrock. They intended to sell LLM access to other cybercriminals, potentially costing victims over $46,000 per day. The attack involved checking credentials against ten AI services and using a reverse proxy to manage access.
- AI system involved
- Claude (v2/v3) on AWS Bedrock
2 source articles · read the reporting →
AI detector falsely accuses student of cheating at Central Methodist University
Moira Olmsted, a student at Central Methodist University, submitted a written assignment and received a zero grade after her professor said an AI detection tool flagged her work as AI-generated. Olmsted alleges the accusation was false and that her writing had been flagged at least once before. The incident highlights the risk of AI detectors falsely accusing students of cheating.
- Company involved
- Central Methodist University
1 source article · read the reporting →
Universities' use of race in student risk algorithms harms Black and Latinx students
The Markup found that several universities, including UMass Amherst, UW–Milwaukee, and Texas A&M, use EAB's Navigate software which incorporates race as a predictor of student dropout risk. The algorithms label Black and Latinx students as high risk at disproportionately high rates compared to White students. Students, professors, and experts worry this is pushing minority students out of math and science majors through biased advising.
- Company involved
- University of Massachusetts Amherst,University of Wisconsin–Milwaukee,Texas A&M University,Texas Tech University,South Dakota State University
- AI system involved
- Navigate
1 source article · read the reporting →
LAUSD shelves AI chatbot after vendor AllHere collapses
Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.
- Company involved
- Los Angeles Unified School District
- AI system involved
- Ed
5 source articles · read the reporting →
Teachers find no value in SAS EVAAS system in Southwest School District
A study examined the SAS Education Value-Added Assessment System (EVAAS®) used by the Southwest School District (SSD) to evaluate teacher effectiveness for high-stakes consequences. Teachers reported that the system produced inconsistent results, was biased by student factors, and reduced morale and collaboration. The study found that teachers did not use the data formatively as intended, and unintended consequences included heightened pressure and teaching to the test.
- Company involved
- Southwest School District (SSD)
- AI system involved
- SAS Education Value-Added Assessment System (EVAAS®)
10 source articles · read the reporting →
Hanoi students caught using AI to cheat in graduation exam
Two students in Hanoi used mobile phones to photograph questions from the national high school graduation exam and submitted them to AI apps like StudyX, Gemini, and ChatGPT for answers. Proctors detected the cheating, and the students were suspended. Hanoi police are investigating the incident, which has raised concerns about exam security and integrity. The students face disqualification and possible administrative or criminal penalties.
- AI system involved
- StudyX, Gemini, ChatGPT
2 source articles · read the reporting →
Texas A&M Professor Uses ChatGPT to Falsely Accuse Students of Cheating
Jared Mumm, an instructor at Texas A&M University–Commerce, used ChatGPT to check if students' writing was AI-generated, leading him to accuse them of using the chatbot. He informed students they would receive an incomplete grade and those deemed guilty would get a zero, causing distress and temporarily withholding one student's diploma. The university investigated and stated that no students failed or were barred from graduating, and the professor is working individually with students to resolve the issue.
- Company involved
- Texas A&M University–Commerce
- AI system involved
- ChatGPT
5 source articles · read the reporting →
Australian education ministers scrap NAPLAN robot marking
The Education Council decided not to use automated essay scoring for NAPLAN writing tests, dropping a proposal by ACARA to have computers mark English tasks. Teachers' unions had campaigned against the plan, and an academic warned that the software would reward verbose gibberish and could not assess creativity. The decision was made in December 2017 and announced in January 2018.
- Company involved
- Australian Curriculum, Assessment and Reporting Authority (ACARA)
10 source articles · read the reporting →
Hangzhou No. 11 Middle School installs facial recognition system to monitor students
Hangzhou No. 11 Middle School has deployed a smart classroom behaviour management system, developed with Hikvision, that uses facial recognition to take attendance and analyse students' expressions and behaviour. The system alerts teachers when students appear inattentive. The school says it records only behavioural state information, not video, and that it will be installed in all classes. Some people have raised privacy concerns.
- Company involved
- 杭州第十一中学
- AI system involved
- 智慧课堂行为管理系统
10 source articles · read the reporting →
Beijing school uses Hanwang emotion recognition system to monitor student behaviour
Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.
- Company involved
- Niulanshan First Secondary School
- AI system involved
- Classroom Care System
10 source articles · read the reporting →
Chinese university deploys facial recognition for attendance monitoring
A university in eastern China has installed a facial recognition system at its entrance and in two classrooms to monitor student attendance and behaviour. The system automatically captures students' faces without their cooperation. The pilot project is intended to improve attendance rates. No specific incidents of harm have been reported.
10 source articles · read the reporting →
NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure
The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.
- Company involved
- NSW Education Standards Authority
- AI system involved
- ChatGPT and Dall-E 2
6 source articles · read the reporting →
China's vocational school students exploited as data annotators for AI
Vocational schools in China force students to work as data annotators for AI companies, paying subminimum wages and taking commissions. Students like Lucy in Shandong spent months labeling data for autonomous driving and content moderation systems, with little learning or career advancement. The practice continues despite new regulations.
2 source articles · read the reporting →
UBC students raise concerns over Proctorio's privacy breach and discrimination
The University of British Columbia (UBC) uses Proctorio, an algorithmic test proctoring software, for remote exams. In June 2020, a UBC student reported an issue with Proctorio, and the company's CEO released the student's support chat logs, sparking privacy concerns. The AMS of UBC published an open letter alleging that Proctorio discriminates against students of colour, those with disabilities, and other groups by flagging 'abnormal' behaviours and denying access. The letter calls on UBC to end its contract with Proctorio and conduct an external audit.
- Company involved
- University of British Columbia
- AI system involved
- Proctorio
10 source articles · read the reporting →
Middle schooler beats Edgenuity grading algorithm to get perfect score
A seventh-grade student in the Los Angeles Unified School District received a failing grade on a history assignment graded by Edgenuity's automated scoring algorithm. With help from his mother, a history professor, he reverse-engineered the algorithm by writing a paragraph with relevant keywords and a jumble of words, earning a perfect score. The incident highlights concerns about the accuracy and fairness of automated grading systems in education.
- Company involved
- Los Angeles Unified School District
- AI system involved
- Edgenuity
10 source articles · read the reporting →
Proctortrack data breach exposed student data from online proctoring
Proctortrack, an online proctoring service used by universities, suffered a data breach in September 2020 when its source code was leaked online. An analysis by Consumer Reports found that the code contained hard-coded passwords and exposed the names and email addresses of over 150 students. The company acknowledged the leak but said no harm resulted. Students had been required to use the software, which performed facial recognition and recorded video during exams.
- Company involved
- Proctortrack
- AI system involved
- Proctortrack
10 source articles · read the reporting →
Proctorio's exam proctoring system allows human agents to review student feeds despite privacy claims
A security researcher analyzed Proctorio's Chrome extension and found evidence that the system allows human agents to review students' room scans and live ID checks, contrary to Proctorio's claims that only professors can access recordings. The system flags students based on behavioral metrics and can terminate exams. The researcher also raised concerns about discrimination against low-income students and privacy violations.
- Company involved
- Proctorio
- AI system involved
- Proctorio
10 source articles · read the reporting →
Student flagged by ProctorU for reading aloud during exam
A college student, Dana Jo, was flagged by ProctorU test proctoring software for talking during an exam, which she says was reading a question aloud. Her professor initially gave her a zero and placed an academic infraction on her record, jeopardizing her scholarships. After reviewing a video recording, the professor apologized, reinstated her grade, and removed the infraction. ProctorU's CEO stated that the incident highlights the importance of video recordings for review.
- Company involved
- University (not named)
- AI system involved
- ProctorU
5 source articles · read the reporting →
