Privacy group files complaint against proctoring companies over AI surveillance
The Electronic Privacy Information Center (EPIC) filed a complaint with the District of Columbia attorney general against five exam proctoring companies—Respondus, ProctorU, Proctorio, Examity, and Honorlock—alleging unfair and deceptive business practices. The companies are accused of using opaque AI algorithms to flag cheating and collecting excessive biometric data from students. Students have reported that the facial recognition software fails to detect dark skin tones, preventing them from taking exams. EPIC has also sent demand letters threatening civil suits if the companies do not stop their practices.
- Company involved
- Proctorio, Respondus, ProctorU, Examity, Honorlock
10 source articles · read the reporting →
Minneapolis schools use Gaggle AI to monitor students' online activity
Minneapolis Public Schools deployed Gaggle, an AI-powered surveillance system, to monitor students' school-issued Google and Microsoft accounts during remote learning. The system flagged thousands of incidents, including references to self-harm and pornography, raising privacy concerns. Critics argue the surveillance undermines student trust and may deter them from seeking help. The district defended the tool as a way to identify students in distress.
- Company involved
- Minneapolis Public Schools
- AI system involved
- Gaggle
9 source articles · read the reporting →
Alpha School parents allege harm from AI-driven learning software
Parents of students at Alpha School in Brownsville, Texas, allege that the school's AI-driven learning software caused their children psychological distress and physical harm. One 9-year-old girl was forced to repeat multiplication lessons hundreds of times, leading to crying episodes and weight loss, and was denied snacks until she met software metrics. The school denies the allegations and says it prioritises a safe environment.
- Company involved
- Alpha School
- AI system involved
- IXL
5 source articles · read the reporting →
Illinois DCFS ends unreliable predictive analytics program for child abuse risk
The Illinois Department of Children and Family Services ended its Rapid Safety Feedback program, which used data mining to predict child abuse risk, after the agency's director called the technology unreliable. The system, developed by Eckerd Connects and Mindshare Technology, assigned risk scores to children but failed to flag several high-profile child deaths. The program was also criticised for overwhelming caseworkers with alerts and for potential bias against poor children of colour. DCFS decided not to renew the contract.
- Company involved
- Illinois Department of Children and Family Services
- AI system involved
- Rapid Safety Feedback
10 source articles · read the reporting →
Cyberattack on UAE TV service shows AI anchor with Gaza content
A cyberattack on Sunday night disrupted TV services for UAE residents using the HK1RBOXX streaming device, replacing regular programming with an AI-generated news bulletin about Palestinian suffering in Gaza. The set-top box provider acknowledged the hack and said it was investigating. The incident caused distress to viewers, including families with children, who were exposed to graphic content.
- Company involved
- HK1RBOXX streaming device provider
- AI system involved
- HK1RBOXX
9 source articles · read the reporting →
Paraná schools use European facial recognition to mark attendance, risking welfare for false absences
Since 2023, the Paraná state education department in Brazil has deployed facial recognition software from Slovak company Innovatrics in over 1,700 schools to automate attendance for nearly one million children. The system has made errors, marking present students as absent. Because attendance records generated by the algorithm affect eligibility for the Bolsa Família welfare program, false absences could threaten families' benefits. In April 2025, the state's public prosecutor filed a legal challenge alleging the system violates Brazilian law; the case is pending.
- Company involved
- Paraná state education department (Secretaria da Educação do Paraná)
- AI system involved
- LRCO Paraná
8 source articles · read the reporting →
Dialpad class action claims AI tech company illegally ‘taps’ T-Mobile customer service calls - Top Class Actions
The system intercepted and recorded telephone conversations of T-Mobile customers calling customer service without their consent.
- Company involved
- Dialpad Inc.
- AI system involved
- Dialpad conversation intelligence platform, DialpadGPT
1 source article · read the reporting →
