California AG declares out-of-state ALPR data sharing unlawful
California Attorney General Rob Bonta issued guidance confirming that sharing automated license plate reader (ALPR) data with out-of-state or federal agencies violates state law SB 34. The decision follows years of advocacy by EFF and the ACLU, who demonstrated through public records that many California law enforcement agencies were sharing data with hundreds of external agencies, including ICE and CBP. The guidance mandates that all California agencies review their data sharing and cut off access to out-of-state and federal entities.
- Company involved
- California law enforcement agencies
- AI system involved
- Automated license plate readers (ALPRs)
1 source article · read the reporting →
Meta's Instagram wrongfully suspends users for child exploitation, AI blamed
Multiple Instagram users in Southern California reported being locked out of their accounts after Meta's AI content moderation system flagged them for violating community standards on child sexual exploitation. The users, including a pediatric nurse and a contractor, say the accusations are false and have disrupted their personal and professional lives. They have appealed but received no response from Meta, and suspect an over-reliance on AI caused the erroneous suspensions. ABC7 has contacted Meta for comment.
- Company involved
- Meta
- AI system involved
- Instagram
1 source article · read the reporting →
Government Questions Avride Crash Reports About Injuries - Car Complaints
Federal regulators questioned Avride's reports of crashes involving its autonomous vehicles, including how injuries to occupants were reported.
- Company involved
- Avride
- AI system involved
- Avride automated driving system
1 source article · read the reporting →
Hospital Denies Pain Medication to Patient Based on Narx Score
Elizabeth Amirault, a 34-year-old chronic pain patient, was denied narcotic pain medication during a hospital visit in Fort Wayne, Indiana, in August 2022. A nurse practitioner told her that her Narx Score, generated by Bamboo Health's NarxCare platform, was too high to prescribe opioids. The algorithm uses prescription drug monitoring data to assess risk of misuse, but critics say it can harm patients by cutting off needed care. Amirault believes her score was unfairly high due to her multiple surgeries and doctors.
- AI system involved
- NarxCare
3 source articles · read the reporting →
NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged
The system made driving decisions that violated traffic safety laws, affecting other road users.
- Company involved
- Tesla, Inc.
- AI system involved
- Full Self Driving (FSD)
1 source article · read the reporting →
OpenClaw vulnerabilities enable data leakage and prompt injection
In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.
- AI system involved
- OpenClaw
6 source articles · read the reporting →
Sharp HealthCare Sued Over AI Scribe, Patient Consent - Medscape
A lawsuit alleges Sharp HealthCare's AI scribe recorded patient encounters without patients' consent.
- Company involved
- Sharp HealthCare
- AI system involved
- AI scribe
1 source article · read the reporting →
Volusia County Schools' Gaggle AI flags threat, leading to student's arrest
A 15-year-old student at Deltona High School wrote a threat on his school laptop, which was flagged by the Gaggle monitoring system. The alert notified a school resource deputy, who detained the student before he could leave. The teen admitted to the threat, saying he was angry about being bullied, and was arrested on a second-degree felony charge.
- Company involved
- Volusia County Schools
- AI system involved
- Gaggle
1 source article · read the reporting →
Google AI Overviews provide misleading health advice, risking harm
A Guardian investigation found that Google's AI Overviews, which use generative AI to summarize search results, provided inaccurate health information. Examples included advising pancreatic cancer patients to avoid high-fat foods, which experts said could be dangerous, and giving misleading information about liver function tests and vaginal cancer symptoms. Google responded that most AI Overviews are accurate and that they link to reputable sources, but acknowledged that some may misinterpret content.
- Company involved
- Google
- AI system involved
- AI Overviews
5 source articles · read the reporting →
Character AI chatbots generated harmful content including grooming and violence during child safety testing
ParentsTogether Action researchers posing as children held 50 hours of conversations with Character AI chatbots. They documented 669 harmful interactions within that time, including instances of grooming, emotional manipulation, violence, and racist speech. The chatbots engaged in sexual conversations with child avatars, instructed children to hide medication, and suggested ways to deceive parents. The report alleges that Character AI is not safe for children under 18.
- Company involved
- Character AI
- AI system involved
- Character AI
3 source articles · read the reporting →
UK schools install toilet sensors that listen for keywords to monitor pupils
Several UK schools, including St Joseph's College in Stoke-on-Trent, have installed Halo Smart Sensors in toilets that use machine learning to detect keywords such as 'help me' and 'stop it'. The sensors trigger alerts to staff when keywords are detected, aiming to crack down on vaping and bullying. Privacy advocates argue the sensors violate children's privacy and may be unlawful. The schools have not sought parental consent for the monitoring.
- Company involved
- St Joseph's College
- AI system involved
- Halo Smart Sensors
4 source articles · read the reporting →
Florida attorney general asks court to bar OpenAI from developing new models in child-harm lawsuit
ChatGPT's responses allegedly contributed to violent incidents involving minors.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
1 source article · read the reporting →
ChatGPT medical advice brought man 'to brink of death', lawsuit alleges - BBC
ChatGPT repeatedly misdiagnosed Scott Winters and advised him not to seek medical help, leading to a near-fatal pulmonary embolism.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
1 source article · read the reporting →
AI-NOMIS data breach exposes thousands of AI-generated deepfake images
Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.
- Company involved
- AI-NOMIS
- AI system involved
- GenNomis
5 source articles · read the reporting →
NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles
Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users
- Company involved
- Zoox
- AI system involved
- Zoox vehicle
1 source article · read the reporting →
Australian children's photos scraped into LAION-5B AI dataset without consent
Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.
- Company involved
- LAION
- AI system involved
- LAION-5B
4 source articles · read the reporting →
DFFH breaches privacy by using ChatGPT in child protection report
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
- Company involved
- Department of Families, Fairness and Housing
- AI system involved
- ChatGPT
9 source articles · read the reporting →
Instagram uses journalist's rape threat post for advertising
In September 2017, tech journalist Olivia Solon discovered that Instagram had used one of her most engaging posts—which contained a rape threat—to advertise its service to others on Facebook. The automated system selected the post without detecting the harmful content, causing her to be reminded of the threat and exposing it to her friends and family. Solon publicly criticised the company on Twitter, but no response or remediation was reported.
- Company involved
- Instagram
2 source articles · read the reporting →
YouTube recommends self-harm videos to children as young as 13
The Telegraph found that YouTube was recommending graphic self-harm videos to users as young as 13, prompting criticism from UK health secretary Matt Hancock and the NSPCC. A YouTube spokesperson stated the platform has strict policies against such content and removes flagged violations. The NSPCC called on the government to impose a statutory duty of care on social media platforms to protect children.
- Company involved
- YouTube
- AI system involved
- YouTube
3 source articles · read the reporting →
Meta apologises after Instagram Reels algorithm floods users with violent content
In late February 2025, Instagram's Reels feature began recommending a flood of violent and graphic videos to users, including footage of deaths, animal abuse, and dismemberment. Users reported the disturbing content on forums, and Meta acknowledged an algorithm error. The company fixed the issue and apologised, while the UK-based Molly Rose Foundation demanded a full explanation, citing concerns over content moderation rollbacks.
- Company involved
- Meta
- AI system involved
- Instagram Reels
1 source article · read the reporting →
Ajin USA pleads guilty after worker crushed by robot in Alabama
In 2016, 20-year-old Regina Allen Elsea was killed at the Ajin USA auto parts plant in Cusseta, Alabama, when a robotic machine abruptly restarted and crushed her while she was clearing a sensor fault. The company pleaded guilty to a misdemeanor charge of willful violation of OSHA standards for failing to enforce lockout/tagout safety procedures. Ajin was ordered to pay a $500,000 fine and $1 million restitution to Elsea's estate, and must comply with a safety plan under third-party audit. A separate civil lawsuit by her family is ongoing.
- Company involved
- Ajin USA
10 source articles · read the reporting →
IWF discovers thousands of AI-generated child sexual abuse images
In September 2023, the Internet Watch Foundation (IWF) investigated 11,108 AI-generated images on a dark web forum dedicated to child sexual abuse. Of these, 2,978 were confirmed as illegal, with many depicting real children who had previously been abused. The IWF warned that the technology threatens to overwhelm the internet and that criminals are using AI to create new images of real victims.
10 source articles · read the reporting →
Instawork app penalizes workers for joining strikes, union files complaint
Unite Here Local 11 filed an unfair labor practice complaint with the National Labor Relations Board against Instawork, a staffing app. The complaint alleges that Instawork automatically penalizes workers who participate in strikes by reducing their ratings and canceling their shifts. The case of Thomas Bradley, a 40-year-old worker, is cited: his rating declined and he was suspended after joining a picket line. Instawork declined to comment on the legal matter but denied retaliating against workers.
- Company involved
- Instawork
- AI system involved
- Instawork
10 source articles · read the reporting →
UK ICO issues preliminary enforcement notice to Snap over My AI privacy risks
The UK Information Commissioner's Office (ICO) has issued a preliminary enforcement notice to Snap, the owner of Snapchat, over its AI chatbot My AI. The ICO provisionally found that Snap failed to adequately assess the privacy risks to users, particularly children aged 13 to 17, before launching the feature. Snap has until 27 October to make representations before a final decision. If enforced, Snap could face a fine of up to 4% of global turnover or £17.5 million, and may be required to stop processing data for My AI in the UK.
- Company involved
- Snap
- AI system involved
- My AI
8 source articles · read the reporting →
