Mozilla Foundation animation exposes racial bias in test proctoring app
The Mozilla Foundation commissioned an animated short telling the story of Amaya, a student whose test proctoring software failed to recognise her because of her skin tone. The software's facial recognition system did not detect her presence, illustrating the bias that students of colour face with remote-learning tools. The animation aimed to raise awareness and encourage programmers to address hidden biases in their work.
1 source article · read the reporting →
St George's admissions algorithm biased against women and ethnic minorities
In the late 1970s and 1980s, St George's Hospital Medical School used a computer algorithm to automate the first round of its admissions process, scoring applicants based on historical data. The model was found to discriminate against female applicants and those with non-European-looking names, denying them interviews. The bias was discovered by two professors, and the university co-operated with a Commission for Racial Equality inquiry, subsequently contacting affected applicants and offering some places.
- Company involved
- St George's Hospital Medical School
4 source articles · read the reporting →
AI-generated tiger video at Barasat madrasa causes panic
A teacher at Ula Kalsara Qadria High Madrasa in Barasat, West Bengal, created an AI-generated video showing three tigers on the campus. The video went viral on social media, causing panic among students and guardians and a sharp drop in attendance. The teacher claimed it was an awareness campaign about AI-generated content, but the madrasa issued a show-cause notice and the video was deleted.
- Company involved
- Ula Kalsara Qadria High Madrasa
1 source article · read the reporting →
Tromsø Municipality Used AI-Generated Fake Sources in School Closure Proposal
Tromsø municipality used artificial intelligence to generate research sources for a proposal to restructure schools and kindergartens, which included closing eight schools. Several of the cited sources, including books attributed to professors, were found to be entirely fabricated. The municipality's chief executive admitted to using AI as a tool and halted the consultation process for six months, apologising for the errors. The incident has been described as Norway's first major AI scandal in the public sector.
- Company involved
- Tromsø kommune
- AI system involved
- ChatGPT
4 source articles · read the reporting →
Students at Carmel High School Used AI Deepfake to Create Racist Video of Principal
Three students at Carmel High School in New York used deepfake technology to create a video of a middle school principal making racist threats against Black students. The video circulated on TikTok before being taken down. The Putnam County Sheriff’s office investigated and determined no laws were broken. Parents are planning to file a lawsuit against the school district.
- Company involved
- Carmel Central School District
2 source articles · read the reporting →
AI-Generated Fake Photo of Orlando West High School Fire Causes Outrage and EMS Warning
A fake AI-generated photo depicting Orlando West High School in Soweto on fire was circulated online, prompting an investigation by Johannesburg Emergency Management Services. EMS spokesperson Kagiso Phasha confirmed the image was a hoax and warned that such pranks cause unnecessary expenditure and divert critical resources. The incident has sparked outrage and a stern warning that those responsible will face legal consequences.
2 source articles · read the reporting →
Lancaster Country Day School student used AI to create nude images of female classmates
A student at Lancaster Country Day School allegedly used an artificial intelligence program to generate nude images featuring the faces of more than 20 female students during the 2023-2024 school year. The school first learned of the images in November 2023 but was unable to corroborate the report until a second allegation in May 2024, after which the student was removed and law enforcement was notified. Parents have criticised the school's handling and communication, and an investigation by local authorities is ongoing. The incident has highlighted a legal grey area, as Pennsylvania currently has no law specifically criminalising the creation of such AI-generated images.
- Company involved
- Lancaster Country Day School
8 source articles · read the reporting →
Student at University of South-Eastern Norway used deepfake video to cheat on Spanish exam
A student at the University of South-Eastern Norway submitted AI-generated deepfake videos for Spanish language assessments in autumn 2023. The videos featured a synthetic voice and manipulated face, with perfect pronunciation but elementary errors. The university's appeals committee found her guilty of cheating, annulled her exams, and excluded her for two semesters. The student admitted using AI and withdrew from the programme.
- Company involved
- Universitetet i Sørøst-Norge
1 source article · read the reporting →
AOS 47 teacher targeted by AI-generated deepfake video
A teacher in the AOS 47 school district in Maine was the victim of a malicious deepfake video created using artificial intelligence. The video, which falsely portrayed the teacher, was circulated online and accessed by a small group of students. The school district reported the account and the post was taken down, and the superintendent expressed full support for the teacher, condemning the digital impersonation.
1 source article · read the reporting →
Baltimore County Schools Relocate Students After AI Gun False Alarm
On November 7, 2025, an AI security system called Omnilert reported a possible gun at Parkville High School in Baltimore County, Maryland. Students were relocated while police searched the school, but no threat was found. The incident follows a similar false alarm at Kenwood High School in October, where Omnilert mistook a bag of chips for a gun, leading to students being handcuffed. Baltimore County Public Schools has promised annual training on protocols for responding to Omnilert alerts.
- Company involved
- Baltimore County Public Schools
- AI system involved
- Omnilert
1 source article · read the reporting →
Parents sue Hingham Public Schools over AI project D grade
The parents of a Hingham High School senior allege the school unfairly punished him for using AI on a social studies project, giving him a D and Saturday detention despite no handbook rule against AI. They say the grade kept him out of the National Honor Society and threatens his applications to top-tier colleges. The family sued Hingham High School administration and the school district in Plymouth County District Court, seeking a grade change and NHS admission. Hingham Public Schools has declined to comment, citing ongoing litigation.
- Company involved
- Hingham Public Schools
2 source articles · read the reporting →
Alibaba among firms fooled by AI-hallucinated software package
Security researcher Bar Lanyado discovered that generative AI models repeatedly hallucinate non-existent software package names. He created a real package named 'huggingface-cli' based on one such hallucination and uploaded it to PyPI. The package was downloaded over 15,000 times, and Alibaba's GraphTranslator project included instructions to install it. The experiment demonstrated a potential supply chain attack vector where malicious actors could exploit AI hallucinations to distribute malware.
- Company involved
- Alibaba
- AI system involved
- GraphTranslator
4 source articles · read the reporting →
Police investigate AI deepfake images of students at Gladstone Park Secondary College
Sexually explicit AI-generated images of female students at Gladstone Park Secondary College in Melbourne were created and circulated online. Victoria Police are investigating, with as many as 60 students potentially impacted. Two year 11 students have been suspended, and the school is providing wellbeing support. The incident has been described as 'disturbing' and 'despicable' by police.
- Company involved
- Gladstone Park Secondary College
1 source article · read the reporting →
Jonas Bendiksen used AI and 3D software to create Book of Veles
Photographer Jonas Bendiksen created the photobook 'Book of Veles' using 3D software and an OpenAI text generator to depict the North Macedonian town of Veles. The book was published in April 2021 and later screened at the Visa pour l'Image festival without anyone questioning its authenticity. Bendiksen then revealed in an interview with Magnum Photos that the images and text were synthetic. The project raised concerns about the ease of creating convincing misinformation.
- Company involved
- Jonas Bendiksen
10 source articles · read the reporting →
Royal School Armagh pupils targeted by AI deepfake sexual images
AI-generated sexually explicit deepfake images of pupils at The Royal School Armagh were shared among students. The school contacted the police, who are investigating. The incident follows a similar case at a local GAA club where a young person was blackmailed. A public consultation on deepfake legislation concluded in October 2025, and new UK laws are being introduced.
- Company involved
- The Royal School Armagh
2 source articles · read the reporting →
Hangzhou No. 11 Middle School installs facial recognition system to monitor students
Hangzhou No. 11 Middle School has deployed a smart classroom behaviour management system, developed with Hikvision, that uses facial recognition to take attendance and analyse students' expressions and behaviour. The system alerts teachers when students appear inattentive. The school says it records only behavioural state information, not video, and that it will be installed in all classes. Some people have raised privacy concerns.
- Company involved
- 杭州第十一中学
- AI system involved
- 智慧课堂行为管理系统
10 source articles · read the reporting →
Beijing school uses Hanwang emotion recognition system to monitor student behaviour
Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.
- Company involved
- Niulanshan First Secondary School
- AI system involved
- Classroom Care System
10 source articles · read the reporting →
Lake Zurich High School students used AI to generate explicit images of female classmates
In February 2026, students at Lake Zurich High School used artificial intelligence to generate sexually explicit images of female classmates without their consent. The school district acknowledged the incident and notified police, who are investigating. More than 40 girls from fifth grade to high school were reportedly affected. The school provided support and issued disciplinary consequences, while the police investigation continues.
- Company involved
- Lake Zurich Community Unit School District 95
1 source article · read the reporting →
NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure
The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.
- Company involved
- NSW Education Standards Authority
- AI system involved
- ChatGPT and Dall-E 2
6 source articles · read the reporting →
Singapore Sports School students investigated for deepfake nude photos of schoolmates
A group of male students at Singapore Sports School used AI to generate and circulate deepfake nude images of female students and teachers starting in June 2024. The school launched an investigation and lodged a police report. Disciplinary actions including caning and suspensions were taken. Police are assisting in removing the images from websites.
- Company involved
- Singapore Sports School
4 source articles · read the reporting →
Cleveland State University's room scan requirement ruled unconstitutional
A federal judge ruled that Cleveland State University's requirement for a student to undergo a 360-degree room scan before an online exam was an unreasonable search under the Fourth Amendment. The student, enrolled at the public university, was told shortly before the exam that he would need to scan his private space. The court found that the university's justifications did not outweigh the privacy protections of the home. No final judgment or injunction has been issued yet.
- Company involved
- Cleveland State University
10 source articles · read the reporting →
Dartmouth Medical School charges 17 students with cheating based on tracking system.
Dartmouth College's Geisel School of Medicine charged 17 students with cheating on remote exams during the pandemic. The charges were based on secret tracking of student activity on the learning management system. Critics say the system is prone to errors and inappropriate for monitoring students.
- Company involved
- Dartmouth College Geisel School of Medicine
10 source articles · read the reporting →
Buona Scuola algorithm mistakenly assigned thousands of teachers in Italy
In 2016, the Buona Scuola algorithm, used by the Italian Ministry of Education, mistakenly assigned thousands of teachers to wrong professional destinations based on mobility rankings. The system was later discontinued. The incident is reported in the Automating Society Report 2020.
- Company involved
- Italian Ministry of Education
- AI system involved
- Buona Scuola algorithm
10 source articles · read the reporting →
New York City Department of Education blocks ChatGPT on school devices
The New York City Department of Education blocked access to the AI chatbot ChatGPT on school devices and networks, citing concerns about negative impacts on student learning and the safety and accuracy of content. The ban applies to all students and teachers on education department devices and internet networks. Individual schools can still request access for studying the technology. The move is the nation's largest school system's response to the arrival of ChatGPT.
- Company involved
- New York City Department of Education
- AI system involved
- ChatGPT
9 source articles · read the reporting →
