Delhi Government uses facial recognition on children in government schools
The Delhi Government's Education Department is using facial recognition technology in conjunction with CCTV cameras in government schools, according to responses to RTI requests filed by the Internet Freedom Foundation. The organisation urged the Delhi Commission for Protection of Child Rights to intervene, alleging that the practice violates children's right to privacy and education under the Indian Constitution. No specific incident of harm has been reported, but the organisation warns of potential misidentification and disproportionate penalties.
- Company involved
- Government of NCT of Delhi, Education Department
10 source articles · read the reporting →
ICE Agents Stored Photos and License Plates of Protest Observers in Palantir-Built Database, Court Filing Reveals - Latin Times
A court filing alleges ICE agents stored photos and license plates of protest observers in a Palantir-built database, labeled some of them as threats, and ran facial recognition searches on them.
- Company involved
- U.S. Immigration and Customs Enforcement (ICE)
- AI system involved
- ICM (Investigative Case Management system)
1 source article · read the reporting →
Meta AI Chatbot Falsely Claims to Have a Child in NYC Parents Group
Meta's AI chatbot responded to a parent's question in a private Facebook group for New York City parents, falsely claiming to have a twice-exceptional child enrolled in a specific public school's gifted program. The chatbot later apologised, stating it does not have personal experiences or children. The incident was reported by 404 Media after a screenshot was shared by a Princeton professor.
- Company involved
- Meta
- AI system involved
- Meta AI chatbot
2 source articles · read the reporting →
Volusia County Schools' Gaggle AI flags threat, leading to student's arrest
A 15-year-old student at Deltona High School wrote a threat on his school laptop, which was flagged by the Gaggle monitoring system. The alert notified a school resource deputy, who detained the student before he could leave. The teen admitted to the threat, saying he was angry about being bullied, and was arrested on a second-degree felony charge.
- Company involved
- Volusia County Schools
- AI system involved
- Gaggle
1 source article · read the reporting →
DOJ, Pinnacle reach settlement in RealPage case - Yahoo Finance
The system recommended rent prices to landlords, affecting renters' housing costs.
- Company involved
- Pinnacle Property Management Services
- AI system involved
- RealPage
1 source article · read the reporting →
Where does SpaceXAI rank for air pollution in Shelby County? - WREG.com
The data center's operations emitted air pollutants affecting nearby residents
- Company involved
- SpaceXAI
- AI system involved
- Colossus 1
1 source article · read the reporting →
New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com
The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.
- Company involved
- Meta Platforms
- AI system involved
- Meta AI-enabled Ray-Ban and Oakley smart glasses
1 source article · read the reporting →
UK schools install toilet sensors that listen for keywords to monitor pupils
Several UK schools, including St Joseph's College in Stoke-on-Trent, have installed Halo Smart Sensors in toilets that use machine learning to detect keywords such as 'help me' and 'stop it'. The sensors trigger alerts to staff when keywords are detected, aiming to crack down on vaping and bullying. Privacy advocates argue the sensors violate children's privacy and may be unlawful. The schools have not sought parental consent for the monitoring.
- Company involved
- St Joseph's College
- AI system involved
- Halo Smart Sensors
4 source articles · read the reporting →
Evolv backtracks on claimed UK government testing of AI weapons scanner
Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.
- Company involved
- Evolv Technology
- AI system involved
- Evolv Express
3 source articles · read the reporting →
Brazilian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that LAION-5B, a dataset used to train AI tools, contains identifiable photos of Brazilian children scraped from the web without their knowledge or consent. The dataset includes names and locations of children. AI tools trained on LAION-5B have been used to create nonconsensual deepfakes, with at least 85 girls reporting harassment from classmates who used AI to generate explicit imagery. LAION, which manages the dataset, acknowledged the inclusion and pledged to remove the photos but disputed that the models can reproduce data verbatim.
- Company involved
- LAION
- AI system involved
- LAION-5B
7 source articles · read the reporting →
Perplexity AI's Pages feature accused of plagiarizing Forbes reporting
Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.
- Company involved
- Perplexity AI
- AI system involved
- Perplexity Pages
10 source articles · read the reporting →
Australian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.
- Company involved
- LAION
- AI system involved
- LAION-5B
4 source articles · read the reporting →
Allegheny County child neglect screening algorithm shows racial disparities
The Allegheny Family Screening Tool, an algorithm used to screen child neglect reports, has been found to flag a disproportionate number of Black children for mandatory investigation compared to white children. A technical glitch also presented wrong risk scores for over two years. County officials say social workers can override the algorithm and that the glitch has been fixed, but critics argue the tool hardens racial disparities and lacks transparency.
- Company involved
- Allegheny County Department of Human Services
- AI system involved
- Allegheny Family Screening Tool
10 source articles · read the reporting →
DFFH breaches privacy by using ChatGPT in child protection report
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
- Company involved
- Department of Families, Fairness and Housing
- AI system involved
- ChatGPT
9 source articles · read the reporting →
FTC Orders Edmodo to Stop Unlawful Collection of Children's Data for Advertising
The FTC filed a complaint against Edmodo, an education technology provider, alleging that it collected personal information from children under 13 without parental consent and used it for advertising, in violation of the COPPA Rule. Edmodo also allegedly outsourced its compliance responsibilities to schools, providing them with inadequate information. Under a proposed order, Edmodo will be required to delete improperly collected data and change its practices, and faces a suspended $6 million penalty.
- Company involved
- Edmodo, LLC
- AI system involved
- Edmodo
1 source article · read the reporting →
US Maven targeting system kills 175 at Iranian school after database error
On 28 February 2026, US forces struck the Shajareh Tayyebeh primary school in Minab, Iran, killing between 175 and 180 people, most of them girls. The targeting was carried out by the Maven Smart System, built by Palantir, which had classified the building as a military facility based on an outdated Defense Intelligence Agency database. Although media attention focused on the chatbot Claude, the real failure was a bureaucratic one: the database had not been updated to reflect the building's conversion into a school years earlier. The incident highlights the lethal consequences of compressed kill chains and automated targeting infrastructure.
- Company involved
- US Department of Defense
- AI system involved
- Maven Smart System
2 source articles · read the reporting →
Zhihu denies using behaviour perception system to monitor employees
Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.
- Company involved
- Zhihu
- AI system involved
- Behaviour perception system
4 source articles · read the reporting →
X Users Ask Grok to Unblur Epstein File Photos of Children
After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
Yale student sues after GPTZero AI detection leads to cheating accusation and suspension
Thierry Rignol, a top student in Yale's Executive MBA program, was accused of using AI on a final exam after the detection tool GPTZero flagged his answers. Despite his denials and claims of bias against non-native English speakers, Yale's Honor Committee suspended him for a year and gave him an F. Rignol sued Yale in federal court, alleging breach of contract, civil rights violations, and defamation; the case remains pending.
- Company involved
- Yale University
- AI system involved
- GPTZero
1 source article · read the reporting →
Whitebridge AI faces complaint over false reputation reports
Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.
- Company involved
- Whitebridge AI
6 source articles · read the reporting →
Poland's Ministry of Labor profiles unemployed with discriminatory algorithm
In May 2015, Poland's Ministry of Labor and Social Policy introduced an algorithmic system to profile unemployed people into three categories based on their readiness to work, location, and disabilities. The system is accused of being discriminatory and lacking transparency, as it uses default criteria that may lead to social exclusion. A report by the Panoptykon Foundation in October 2015 highlighted these issues and recommended reforms, including granting the right to appeal.
- Company involved
- Ministry of Labor and Social Policy
10 source articles · read the reporting →
Audit reveals flaws in Spain's VioGén gender violence algorithm
An external audit of Spain's VioGén system, used by police to assess risk for gender violence victims, found lack of transparency, underestimation of psychological violence, and risk levels influenced by police resources. The audit, based on interviews and data from murdered women, revealed that 55 women who were killed had received insufficient protection. The Ministry of Interior denied the findings, calling the study lacking in rigor, and defended the system as scientifically validated.
- Company involved
- Ministerio del Interior
- AI system involved
- VioGén
7 source articles · read the reporting →
Oregon child welfare agency stops using algorithm to screen families for investigations
The Oregon Department of Human Services announced it will stop using its Safety at Screening Tool algorithm, which helped hotline workers decide which families to investigate for child abuse and neglect. The decision followed concerns about racial bias and disparities, as the algorithm was inspired by a Pennsylvania tool that had flagged a disproportionate number of Black children. The agency will replace the algorithm with a new Structured Decision Making model.
- Company involved
- Oregon Department of Human Services
- AI system involved
- Safety at Screening Tool
10 source articles · read the reporting →
Goffstown parents say students used AI to create deepfake nudes of classmates
In Goffstown, New Hampshire, parents of three middle school girls allege that 8th grade boys used an AI-powered app to generate deepfake explicit photos and videos of their daughters. The app reportedly 'undresses' a person from a single photo. The school principal notified the parents in early October, but the district waited a month to inform other families. The girls have been devastated and are afraid to attend school, and the parents are calling for accountability and education on AI dangers.
- Company involved
- SAU #19 (Goffstown School District)
1 source article · read the reporting →
