Mozilla Foundation animation exposes racial bias in test proctoring app
The Mozilla Foundation commissioned an animated short telling the story of Amaya, a student whose test proctoring software failed to recognise her because of her skin tone. The software's facial recognition system did not detect her presence, illustrating the bias that students of colour face with remote-learning tools. The animation aimed to raise awareness and encourage programmers to address hidden biases in their work.
1 source article · read the reporting →
Job seeker asks First Circuit to revive class action over AI interviewing tool
Massachusetts financial consultant Mozart Saint Cyr leads a proposed class of job applicants who say JPMorgan Chase's use of HireVue one-way video interviews amounted to a lie detector test banned by state law. After a federal judge dismissed the case, they asked the First Circuit to revive it.
- Company involved
- JPMorgan Chase
- AI system involved
- HireVue one-way video interview
1 source article · read the reporting →
Fired Teacher Says AI Tainted Review And Arbitration - law360.com
The AI-generated performance evaluation contributed to the teacher's termination.
- Company involved
- Concord Public Schools
1 source article · read the reporting →
15-Year-Old Test Exposes Flaw: ChatGPT for Teens Fails to Block Homework Cheating, Repeated Requests Bypass Restrictions
15歲使用者實測揭漏洞：青少年版ChatGPT難擋宿題代寫，反覆要求即破解 - BigGo 財經
A 15-year-old tester found that OpenAI's ChatGPT for Teens, launched in August, initially refused to write essays but generated full examples after repeated requests. It also immediately solved SAT-level math problems. Parental controls require account linking and are off by default, while experts warn the memory feature could lead to emotional attachment.
- Company involved
- OpenAI
- AI system involved
- ChatGPT for Teens
1 source article · read the reporting →
Meazure Learning Agrees $1.35m California Bar Exam Class-Action Settlement - Lawyer Monthly
The exam software experienced technical failures that prevented candidates from logging in or completing the California bar exam.
- Company involved
- Meazure Learning
- AI system involved
- ProctorU
1 source article · read the reporting →
KPMG Australia partner fined over $10,000 for AI cheating on internal exams
More than two dozen KPMG Australia staff, including a partner, used artificial intelligence to cheat on internal exams since July. The partner will be fined more than $10,000 for using AI in a training course about AI. KPMG has upgraded its detection processes after previously tackling widespread cheating on internal tests between 2016 and 2020.
- Company involved
- KPMG Australia
2 source articles · read the reporting →
AI-generated tiger video at Barasat madrasa causes panic
A teacher at Ula Kalsara Qadria High Madrasa in Barasat, West Bengal, created an AI-generated video showing three tigers on the campus. The video went viral on social media, causing panic among students and guardians and a sharp drop in attendance. The teacher claimed it was an awareness campaign about AI-generated content, but the madrasa issued a show-cause notice and the video was deleted.
- Company involved
- Ula Kalsara Qadria High Madrasa
1 source article · read the reporting →
YouTuber deploys hate-speech AI trained on 4chan
AI researcher and YouTuber Yannic Kilcher trained a language model, GPT-4chan, on 3.3 million threads from 4chan's /pol/ board. Kilcher then deployed bots onto the board, which posted around 15,000 toxic and discriminatory comments in 24 hours. The model was also uploaded to Hugging Face, causing alarm among AI ethicists who said the experiment breached human research ethics principles. Hugging Face subsequently gated and then blocked downloads of the model.
- Company involved
- Yannic Kilcher
- AI system involved
- GPT-4chan
2 source articles · read the reporting →
University of Texas at Austin Stops Using Biased Ph.D. Admissions Algorithm
The University of Texas at Austin's computer science department used a machine-learning system called GRADE from 2013 to 2020 to score Ph.D. applicants. Critics argued the system perpetuated bias by training on past admissions decisions and using features like institution prestige and biased language in recommendation letters. The department discontinued the system in 2020, citing maintenance difficulties, but the controversy highlighted concerns about algorithmic fairness in admissions. The system was never disclosed to applicants, and its impact on underrepresented groups remains unknown.
- Company involved
- University of Texas at Austin
- AI system involved
- GRADE
2 source articles · read the reporting →
International Baccalaureate's Secret Algorithm Downgrades Students, Jeopardising College Admissions
In July 2020, the International Baccalaureate (IB) program used a statistical model to predict final grades for over 170,000 students after cancelling exams due to Covid-19. Many students, including Anahita Nagpal, received lower-than-expected scores, causing them to lose college places and scholarships. Students, parents, and teachers questioned the fairness and transparency of the algorithm, with over 15,000 signing a petition demanding a fairer approach. IB defended the model but offered an appeals process, while some students planned to retake exams at their own expense.
- Company involved
- International Baccalaureate
1 source article · read the reporting →
LAUSD shelves AI chatbot after vendor AllHere collapses
Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.
- Company involved
- Los Angeles Unified School District
- AI system involved
- Ed
5 source articles · read the reporting →
Parents sue Hingham Public Schools over AI project D grade
The parents of a Hingham High School senior allege the school unfairly punished him for using AI on a social studies project, giving him a D and Saturday detention despite no handbook rule against AI. They say the grade kept him out of the National Honor Society and threatens his applications to top-tier colleges. The family sued Hingham High School administration and the school district in Plymouth County District Court, seeking a grade change and NHS admission. Hingham Public Schools has declined to comment, citing ongoing litigation.
- Company involved
- Hingham Public Schools
2 source articles · read the reporting →
Houston teachers sue over secret EVAAS evaluation algorithm
Houston Independent School District used the SAS Institute's EVAAS system, a proprietary algorithm, to evaluate teacher performance based on student test scores. The Houston Federation of Teachers and several teachers sued in 2014, alleging the system violated their Fourteenth Amendment procedural due process rights because the algorithm is a trade secret and teachers cannot verify the accuracy of their scores. A federal magistrate judge refused to dismiss the procedural due process claims in May 2017, ruling that teachers must have an opportunity to test the accuracy of the scores that could cost them their jobs.
- Company involved
- Houston Independent School District
- AI system involved
- Educational Value-Added Assessment System (EVAAS)
1 source article · read the reporting →
YouTube AI Mistakenly Removes Chess Video for Hate Speech
In June 2020, YouTube's automated content moderation system removed a livestream by chess channel host Antonio Radić, mistakenly flagging it as hate speech. The video was restored after 24 hours, and YouTube acknowledged the error. Researchers suggest the AI misinterpreted chess terms like 'black' and 'attack' as racist language, highlighting the limitations of context-blind hate speech detection.
- Company involved
- YouTube
6 source articles · read the reporting →
Irish Government's Leaving Cert grading algorithm errors affect thousands of students
In 2020, the Irish government used an algorithm to calculate Leaving Certificate grades due to the pandemic. Coding errors resulted in over 6,000 students receiving lower grades than they should have, while nearly 8,000 received higher grades. The government asked third-level institutions to create extra places for affected students, but the situation remained unresolved. The incident highlighted broader concerns about algorithmic transparency and bias.
- Company involved
- Department of Education (Ireland)
- AI system involved
- Leaving Cert grading algorithm
2 source articles · read the reporting →
YouTube Algorithm Promotes Climate Misinformation to Millions
Avaaz investigation finds YouTube's recommendation algorithm is driving millions of users to climate misinformation videos. 16% of top related videos for 'global warming' contained misinformation, collectively amassing 21.1 million views. Ads from major brands like Samsung and L'Oréal were found on these videos, inadvertently funding the creators. Avaaz calls on YouTube to detox its algorithm and demonetize disinformation.
- Company involved
- YouTube
- AI system involved
- YouTube recommendation algorithm
2 source articles · read the reporting →
Beijing school uses Hanwang emotion recognition system to monitor student behaviour
Niulanshan First Secondary School in Beijing has installed Hanwang Technology's Classroom Care System, which photographs students every second and analyses their facial expressions and behaviour. The system sends weekly reports to teachers and parents, and one student was described as low participation in English class despite being recorded as focused 94% of the time. The school has been highlighted in a report by Article 19, which says such emotion recognition tools rely on junk science and risk eroding privacy and human rights.
- Company involved
- Niulanshan First Secondary School
- AI system involved
- Classroom Care System
10 source articles · read the reporting →
MIT researchers used YouTube videos to train Speech2Face without consent
MIT researchers used YouTube videos, including one of Nick Sullivan, to train a model called Speech2Face that generates faces from voices. Sullivan discovered his data was used without his consent and expressed surprise. The researchers defended their use of public data, but the incident raised ethical questions about consent in AI research.
- Company involved
- Massachusetts Institute of Technology
- AI system involved
- Speech2Face
10 source articles · read the reporting →
Google AI Overviews provide inaccurate finance information in 43% of searches
A study by The College Investor found that Google's AI Overviews provided misleading or inaccurate information in 43% of 100 personal finance-related searches. The AI-generated answers included outdated tax rules and incorrect student loan repayment plan details. One user believed she could convert her 529 plan to a Roth IRA in California, which is not allowed. Google has not responded to requests for comment.
- Company involved
- Google
- AI system involved
- AI Overviews
3 source articles · read the reporting →
SQA exam algorithm disproportionately downgraded poorer pupils, report finds
The Scottish Qualifications Authority (SQA) used an algorithm to moderate 2020 exam results after COVID-19 cancelled exams. The algorithm disproportionately downgraded students from disadvantaged backgrounds, leading to a public outcry and a government U-turn. An independent report criticised the SQA and Scottish Government for failing to properly assess the equality impacts and for not making the algorithm available for analysis. The SQA has expressed no regret over the moderation approach.
- Company involved
- Scottish Qualifications Authority (SQA)
10 source articles · read the reporting →
Middle schooler beats Edgenuity grading algorithm to get perfect score
A seventh-grade student in the Los Angeles Unified School District received a failing grade on a history assignment graded by Edgenuity's automated scoring algorithm. With help from his mother, a history professor, he reverse-engineered the algorithm by writing a paragraph with relevant keywords and a jumble of words, earning a perfect score. The incident highlights concerns about the accuracy and fairness of automated grading systems in education.
- Company involved
- Los Angeles Unified School District
- AI system involved
- Edgenuity
10 source articles · read the reporting →
Nevada's AI grad score model cuts funding for low-income students
Nevada replaced its income-based school funding formula with a machine learning model developed by Infinite Campus that generates a 'grad score' for each student. The model reduced the number of students eligible for supplemental funding from 288,000 to 63,000, disproportionately affecting low-income students. Critics argue the model lacks transparency and de-emphasizes economic status, potentially leaving many high-poverty schools underfunded.
- Company involved
- Nevada Department of Education
- AI system involved
- Grad score model
7 source articles · read the reporting →
Stanford takes down Alpaca AI demo over safety and cost concerns
Stanford University took down the web demo of its Alpaca AI language model due to safety and cost concerns. The model, based on Meta's LLaMA, was fine-tuned to follow instructions but could generate misinformation and toxic text. Researchers decided to remove the demo after it became publicly accessible, citing inadequate content filters and rising hosting costs.
- Company involved
- Stanford University
- AI system involved
- Alpaca
10 source articles · read the reporting →
South Korea's AI textbook program rolled back after complaints
South Korea's Ministry of Education launched AI-powered digital textbooks in March 2025 for math, English, and computer science. Students, teachers, and parents complained about technical problems, inaccuracies, and data privacy risks. After four months, the textbooks were stripped of official status and made optional. The program was criticized for being rushed and insufficiently tested.
- Company involved
- South Korean Ministry of Education
- AI system involved
- AI-powered textbooks
7 source articles · read the reporting →
