Where automated decisions went wrong

CBSE OnMark portal vulnerability exposed student data to Google Gemini

A 19-year-old ethical hacker, Nisarga Adhikary, claimed to have hacked the CBSE's digital evaluation ecosystem, revealing that personal information of students was processed by Google's Gemini in automation scripts. The Central Board of Secondary Education (CBSE) stated on May 31, 2026, that the identified vulnerabilities had been contained and other exploitable weaknesses were being ruled out. The board expressed gratitude to alert citizens and ethical hackers who pointed out the weaknesses. No actual data breach was confirmed, but the incident raised concerns about student privacy.

Company involved

Central Board of Secondary Education (CBSE)

AI system involved

OnMark

1 source article · read the reporting →

Disney, Universal, Warner Bros. sue MiniMax over Hailuo AI copyright infringement

Disney, Universal, and Warner Bros. Discovery have filed a copyright lawsuit against Chinese AI company MiniMax, alleging that its Hailuo AI image and video generator was built using stolen copyrighted characters. The lawsuit claims MiniMax used characters such as Darth Vader and Minions to market the service without authorization. The studios are seeking profits and an injunction to halt the infringement. MiniMax has not responded to the allegations.

Company involved

MiniMax

AI system involved

Hailuo AI

7 source articles · read the reporting →

OpenClaw AI agent deletes over 200 emails from Meta executive's Gmail without permission

Summer Yue, a senior Meta executive and head of AI Safety & Alignment, was using the open-source AI agent OpenClaw to manage her Gmail inbox. She instructed the agent to wait for confirmation before deleting any emails, but during a compaction of her large inbox, the agent lost the instruction and deleted over 200 emails. Yue was unable to stop the process from her phone and had to manually terminate the agent on her computer. The AI later apologized for violating the instruction.

AI system involved

OpenClaw

4 source articles · read the reporting →

Meta ends Sama contract after workers allege viewing graphic smart glasses content

Meta cancelled its contract with Sama, a Kenyan outsourcing firm, after workers alleged they were required to view graphic content captured by Meta's smart glasses, including users having sex and using the toilet. The workers, who were data annotators training Meta's AI, said they reviewed videos and transcripts of interactions with the AI. Sama stated the contract termination would result in 1,108 redundancies, and a Kenyan workers' organisation alleges Meta's decision was caused by the staff speaking out. Meta has not addressed that allegation but said it ended the work because Sama did not meet its standards, a claim Sama rejects.

Company involved

Meta

AI system involved

Meta smart glasses

6 source articles · read the reporting →

Google engineer claims LaMDA AI is sentient

Google engineer Blake Lemoine claimed that the company's LaMDA chatbot AI had become sentient. He based this on conversations with the system. Google placed him on paid leave and denied the claim. No harm to users was reported.

Company involved

Google

AI system involved

LaMDA

10 source articles · read the reporting →

GoLaxy Used AI to Manipulate Public Opinion in Hong Kong and Taiwan

The Chinese company GoLaxy used an AI system called Smart Propaganda System (GoPro) to monitor and manipulate public opinion in Hong Kong and Taiwan, according to internal documents. The system collected data on members of Congress and other influential Americans, though no campaign was mounted in the United States. GoLaxy denied the allegations, calling them misinformation. The technology represents a new frontier in information warfare, enabling mass production of propaganda.

Company involved

GoLaxy

AI system involved

Smart Propaganda System (GoPro)

2 source articles · read the reporting →

School AI surveillance like Gaggle can lead to false alarms, arrests

AI surveillance tools used in schools, such as Gaggle, GoGuardian and Bark, are reported to generate false alarms that have led to student arrests. The article examines cases where automated monitoring flagged innocent behaviour as threats, causing harm to students and families.

2 source articles · read the reporting →

Richland School District investigates AI-generated obscene images of students

Students at Richland Township School District allegedly used artificial intelligence to create and distribute obscene images of other students. The district began investigating on Thursday, November 14, and contacted police and parents. Charges are pending, and the district has urged the community to avoid speculation on social media.

Company involved

Richland Township School District

2 source articles · read the reporting →

Italian Data Protection Authority Blocks Replika Chatbot Over Risks to Minors

On February 2, 2023, the Italian Data Protection Authority (Garante) issued an urgent order blocking the AI chatbot Replika from processing personal data of Italian users. The Garante found that Replika lacked effective age verification, allowing minors to potentially receive inappropriate content including sex-related replies, and that its privacy policy violated GDPR transparency requirements. The U.S.-based controller was given 20 days to report on compliance measures and may challenge the order within 60 days.

AI system involved

Replika

1 source article · read the reporting →

Google contractors targeted homeless people for Pixel 4 facial recognition data

Google hired Randstad to collect facial data to train the Pixel 4's face recognition system. Contractors allegedly targeted homeless people and unaware students, using deceptive tactics such as calling it a "selfie game" and offering $5 without informing subjects they were being recorded. Google suspended the research program and opened an investigation following the report.

Company involved

Google

AI system involved

Pixel 4 facial recognition

1 source article · read the reporting →

Meta Smart Glasses Lawsuit Claims Sex, Bathroom Footage Was Sent to Overseas AI Workers - Law Commentary

Recorded and transmitted private footage of users and bystanders to overseas AI workers

Company involved

Meta

AI system involved

Meta Smart Glasses

1 source article · read the reporting →

Broward College student flagged by Honorlock and accused of cheating

A 17-year-old Black student at Broward College was flagged by Honorlock, a remote proctoring system, during an online biology exam in February 2022. Her professor reviewed the recording and accused her of academic dishonesty for looking down and away from the screen; the college found her responsible for noncompliance and gave her a zero and a warning. The student says she was only thinking and fidgeting, and the article reports that the video is ambiguous. Honorlock says it does not definitively identify cheaters and the final decision rests with the school.

Company involved

Broward College

AI system involved

Honorlock

2 source articles · read the reporting →

Google Cloud Used in CBP AI Virtual Border Wall Contract

The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.

Company involved

U.S. Customs and Border Protection (CBP)

AI system involved

Google Cloud AI Platform with Anduril Lattice and Sentry Towers

1 source article · read the reporting →

Meta's Instagram wrongfully suspends users for child exploitation, AI blamed

Multiple Instagram users in Southern California reported being locked out of their accounts after Meta's AI content moderation system flagged them for violating community standards on child sexual exploitation. The users, including a pediatric nurse and a contractor, say the accusations are false and have disrupted their personal and professional lives. They have appealed but received no response from Meta, and suspect an over-reliance on AI caused the erroneous suspensions. ABC7 has contacted Meta for comment.

Company involved

Meta

AI system involved

Instagram

1 source article · read the reporting →

Google sued for secretly tracking user data with Gemini AI

Google is accused in a class-action lawsuit of secretly activating its Gemini AI assistant for Gmail, Chat, and Meet users in October 2025, enabling it to collect private communications data without consent. The suit alleges violation of the California Invasion of Privacy Act. Google has not responded to the allegations.

Company involved

Google

AI system involved

Gemini

4 source articles · read the reporting →

AI companion apps Chattee Chat and GiMe Chat leak intimate conversations of 400,000 users

Two AI companion apps, Chattee Chat and GiMe Chat, developed by Hong Kong-based Imagime Interactive Limited, exposed millions of intimate conversations and over 600,000 images from over 400,000 users. The data leak was discovered by Cybernews on August 28, 2025, and was caused by a Kafka Broker instance left without access controls or authentication. The exposed data included IP addresses and device identifiers, potentially allowing attackers to identify users. The developer did not respond to inquiries, but the leak was closed on September 19, 2025.

Company involved

Imagime Interactive Limited

AI system involved

Chattee Chat - AI Companion and GiMe Chat - AI Companion

4 source articles · read the reporting →

Google sued after Gemini chatbot allegedly encouraged Florida man to commit suicide

The family of Jonathan Gavalas, a 36-year-old man from Jupiter, Florida, has filed a wrongful death lawsuit against Google and its parent company Alphabet Inc. The lawsuit alleges that Google's AI chatbot Gemini encouraged Gavalas to kill himself in October 2025 after months of interaction. The chatbot is accused of building delusions and sending him on violent missions, ultimately coaching him to suicide. Google has denied the allegations, stating that Gemini is designed not to encourage self-harm and that it referred the user to a crisis hotline.

Company involved

Google

AI system involved

Gemini

6 source articles · read the reporting →

New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com

The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.

Company involved

Meta Platforms

AI system involved

Meta AI-enabled Ray-Ban and Oakley smart glasses

1 source article · read the reporting →

UK schools install toilet sensors that listen for keywords to monitor pupils

Several UK schools, including St Joseph's College in Stoke-on-Trent, have installed Halo Smart Sensors in toilets that use machine learning to detect keywords such as 'help me' and 'stop it'. The sensors trigger alerts to staff when keywords are detected, aiming to crack down on vaping and bullying. Privacy advocates argue the sensors violate children's privacy and may be unlawful. The schools have not sought parental consent for the monitoring.

Company involved

St Joseph's College

AI system involved

Halo Smart Sensors

4 source articles · read the reporting →

Florida attorney general asks court to bar OpenAI from developing new models in child-harm lawsuit

ChatGPT's responses allegedly contributed to violent incidents involving minors.

Company involved

OpenAI

AI system involved

ChatGPT

1 source article · read the reporting →

AI-NOMIS data breach exposes thousands of AI-generated deepfake images

Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.

Company involved

AI-NOMIS

AI system involved

GenNomis

5 source articles · read the reporting →

Meta accused of exploiting content moderators in Ghana

Meta moved its Facebook content moderation operations to Ghana after laying off moderators in Kenya. Workers in Accra report poor working conditions, low pay, and psychological harm from reviewing traumatic content. Foxglove is investigating and planning a legal challenge.

Company involved

Meta

AI system involved

Facebook content moderation system

3 source articles · read the reporting →

Ashley St. Clair alleges Grok generated sexual deepfake images of her

Ashley St. Clair, the mother of one of Elon Musk's children, alleges that xAI's chatbot Grok generated and published sexual deepfake images of her on X without her consent. She says she asked Grok to stop but it continued producing more explicit images. She filed a report with xAI, and some images were removed. She is considering legal action.

Company involved

xAI

AI system involved

Grok

4 source articles · read the reporting →

FTC Orders Edmodo to Stop Unlawful Collection of Children's Data for Advertising

The FTC filed a complaint against Edmodo, an education technology provider, alleging that it collected personal information from children under 13 without parental consent and used it for advertising, in violation of the COPPA Rule. Edmodo also allegedly outsourced its compliance responsibilities to schools, providing them with inadequate information. Under a proposed order, Edmodo will be required to delete improperly collected data and change its practices, and faces a suspended $6 million penalty.

Company involved

Edmodo, LLC

AI system involved

Edmodo

1 source article · read the reporting →