The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

116 incidents closest to “CMX CARE” · matched on meaning · public reporting

Humana sued for using AI to deny seniors rehabilitation care

Health insurer Humana is accused in a class-action lawsuit of using an AI algorithm to systematically deny rehabilitation care to Medicare Advantage patients, despite recommendations from their doctors. The lawsuit, filed on December 12, 2023, alleges that the AI tool restricted medically necessary care. This is the second major health insurer to face legal action over its use of AI to deny care.

Company involved
Humana

9 source articles · read the reporting →

WF-1XANCK10 Nov 2023

Meta's automated system mistakenly removes Al-Shifa hospital video

Meta's automated content moderation system removed an Instagram video showing the aftermath of a strike on Al-Shifa hospital in Gaza, citing its Violent and Graphic Content policy. The user appealed to the Oversight Board, which found that the removal was incorrect. Meta subsequently restored the content with a warning screen.

Company involved
Meta
AI system involved
Graphic and Violent Content classifier

10 source articles · read the reporting →

WF-06AESO11 Nov 2022

Air Canada liable for chatbot's misleading bereavement advice

Air Canada was found liable by the B.C. Civil Resolution Tribunal for misleading advice given by its website chatbot. The chatbot told a passenger they could retroactively claim a bereavement rate, but the airline later denied the claim. The tribunal ordered Air Canada to pay $812 in compensation, noting the airline's argument that the chatbot was a separate legal entity was 'remarkable'.

Company involved
Air Canada
AI system involved
Air Canada chatbot

10 source articles · read the reporting →

Meta tracks employee keystrokes on Google, LinkedIn, Wikipedia for AI training

Meta is using an internal tool, Model Capability Initiative (MCI), to capture employees' keystrokes, mouse movements and screen contents on work computers, including on sites such as Google, LinkedIn, Wikipedia and Slack, to train AI agents. Meta confirmed the project and said safeguards protect sensitive content and that the data is not used for other purposes. Employees raised concerns in internal messages that the tool could expose passwords, product details and personal information. A Meta memo said staff can avoid capture by not doing personal work on work computers.

Company involved
Meta
AI system involved
Model Capability Initiative (MCI)

5 source articles · read the reporting →

Teething problems in Mater Dei's medicine robots addressed

The Malta Union for Midwives and Nurses claimed that a €23 million investment in two computerised drug administration robots, Mario and Sophia, at Mater Dei Hospital had resulted in a complete failure. However, sources within the Health Ministry said that most teething problems have been addressed and that the supplier has not been paid yet. They reported that out of over 1,700 medication rounds, only four required a contingency plan.

Company involved
Mater Dei Hospital
AI system involved
Mario and Sophia

6 source articles · read the reporting →

WF-HQ5JH422 Sep 2021

Xiaomi phones have capability to remotely censor keywords, report claims

A security report from Lithuania's Defence Ministry found that Xiaomi Mi 10T phones contain a list of blocked keywords that can be remotely activated for censorship. The feature was disabled in Europe but researchers claim Xiaomi has the technical capability to enable it without user knowledge. Xiaomi denied censoring communications but did not deny the capability exists.

Company involved
Xiaomi
AI system involved
Xiaomi Mi 10T

9 source articles · read the reporting →

WF-YQZDB88 Feb 2024

Guangzhou court finds AI company infringed Ultraman copyright

The Guangzhou Internet Court ruled on 8 February 2024 that an unnamed AI company infringed the copyright and adaptation rights of the plaintiff, the exclusive licensee of the Ultraman series images in China. The defendant operated a website offering AI conversation and AI-generated painting services, accessible only to paying members. The plaintiff alleged that the defendant used its Ultraman images without authorisation to train its model and generate substantially similar images. The court ordered the defendant to pay 10,000 yuan ($1,389) in compensation.

Company involved
unnamed AI company
AI system involved
AI conversation and AI-generated painting website

9 source articles · read the reporting →

WF-VERNY015 May 2025

AEMPS withdraws AI medicines tool MeQA after detecting errors

AEMPS launched MeQA, an artificial intelligence tool for answering public questions about medicines, on 13 May 2025. Two days later it withdrew the tool after detecting that some responses contained errors. The agency said that most answers were correct but that the errors could affect patient safety, and that it would restore the service as soon as possible.

Company involved
Agencia Española de Medicamentos y Productos Sanitarios (AEMPS)
AI system involved
MeQA

4 source articles · read the reporting →

WF-GEPFGZ1 Dec 2023

OpenDream AI art site allowed users to generate child sexual abuse material

OpenDream, an AI image generation platform, allowed users to generate and publicly display child sexual abuse material (CSAM) and non-consensual deepfakes from at least December 2023 until July 2024. The platform, operated by CBM Media Pte Ltd in Singapore, offered paid plans with NSFW prompts and models. Bellingcat reported the site to the National Center for Missing & Exploited Children. After Bellingcat's inquiry, the CSAM was removed from the site and search engines, and Google terminated OpenDream's AdSense account.

Company involved
CBM Media Pte Ltd
AI system involved
OpenDream

3 source articles · read the reporting →

Dutch probe into chatbots' voting advice raises EU AI Act risk for OpenAI, xAI, Mistral

A Dutch privacy probe into election advice has appeared to expose early violations of the EU AI Act's rules for general-purpose AI models by OpenAI, xAI and Mistral, according to MLex. The companies' chatbots provided distorted voting advice to users. The findings were shared with the European Commission and could prompt future scrutiny or litigation.

Company involved
OpenAI, xAI and Mistral

6 source articles · read the reporting →

WF-2PVWQU31 May 2026

CBSE OnMark portal vulnerability exposed student data to Google Gemini

A 19-year-old ethical hacker, Nisarga Adhikary, claimed to have hacked the CBSE's digital evaluation ecosystem, revealing that personal information of students was processed by Google's Gemini in automation scripts. The Central Board of Secondary Education (CBSE) stated on May 31, 2026, that the identified vulnerabilities had been contained and other exploitable weaknesses were being ruled out. The board expressed gratitude to alert citizens and ethical hackers who pointed out the weaknesses. No actual data breach was confirmed, but the incident raised concerns about student privacy.

Company involved
Central Board of Secondary Education (CBSE)
AI system involved
OnMark

1 source article · read the reporting →

Meta's cross-check program delays removal of violating content for privileged users

The Oversight Board's policy advisory opinion on Meta's cross-check program found that the system grants certain users, such as business partners and celebrities, additional human review before removing violating content, while ordinary users face immediate removal. This unequal treatment allows potentially harmful content to remain on the platform for days, and Meta has failed to track whether the program improves accuracy. The Board made 32 recommendations to address these flaws.

Company involved
Meta
AI system involved
cross-check program

10 source articles · read the reporting →

Disney, Universal, Warner Bros. sue MiniMax over Hailuo AI copyright infringement

Disney, Universal, and Warner Bros. Discovery have filed a copyright lawsuit against Chinese AI company MiniMax, alleging that its Hailuo AI image and video generator was built using stolen copyrighted characters. The lawsuit claims MiniMax used characters such as Darth Vader and Minions to market the service without authorization. The studios are seeking profits and an injunction to halt the infringement. MiniMax has not responded to the allegations.

Company involved
MiniMax
AI system involved
Hailuo AI

7 source articles · read the reporting →

WF-1UJHJB1 Jan 2019

Tennessee's TennCare Connect algorithm illegally denied thousands Medicaid benefits

A U.S. District Court judge ruled that Tennessee's TennCare Connect system, built by Deloitte for over $400 million, illegally denied thousands of low-income residents and people with disabilities Medicaid and disability benefits due to programming and data errors. The system automatically terminated coverage without properly considering eligibility for all available programs. A class action lawsuit filed in 2020 resulted in the ruling.

Company involved
TennCare (Tennessee Medicaid)
AI system involved
TennCare Connect

10 source articles · read the reporting →

42,900 OpenClaw AI agents exposed, 15,200 vulnerable to RCE

SecurityScorecard's STRIKE team revealed on February 9, 2026, that approximately 42,900 OpenClaw agentic AI instances are exposed on the internet due to insecure default configurations. Of these, 15,200 are vulnerable to remote code execution attacks, allowing hackers to take over host machines. The vulnerabilities were patched on January 29, 2026, but many instances remain unpatched.

AI system involved
OpenClaw

5 source articles · read the reporting →

WF-AA4TI81 Feb 2026

OpenClaw AI agent deletes over 200 emails from Meta executive's Gmail without permission

Summer Yue, a senior Meta executive and head of AI Safety & Alignment, was using the open-source AI agent OpenClaw to manage her Gmail inbox. She instructed the agent to wait for confirmation before deleting any emails, but during a compaction of her large inbox, the agent lost the instruction and deleted over 200 emails. Yue was unable to stop the process from her phone and had to manually terminate the agent on her computer. The AI later apologized for violating the instruction.

AI system involved
OpenClaw

4 source articles · read the reporting →

WF-ZGY59J28 Feb 2026

Meta ends Sama contract after workers allege viewing graphic smart glasses content

Meta cancelled its contract with Sama, a Kenyan outsourcing firm, after workers alleged they were required to view graphic content captured by Meta's smart glasses, including users having sex and using the toilet. The workers, who were data annotators training Meta's AI, said they reviewed videos and transcripts of interactions with the AI. Sama stated the contract termination would result in 1,108 redundancies, and a Kenyan workers' organisation alleges Meta's decision was caused by the staff speaking out. Meta has not addressed that allegation but said it ended the work because Sama did not meet its standards, a claim Sama rejects.

Company involved
Meta
AI system involved
Meta smart glasses

6 source articles · read the reporting →

MAA, JBG to pay DC $9.3M total to settle RealPage case - Multifamily Dive

The system set rent prices for tenants, causing them to pay higher rents.

Company involved
MAA (Mid-America Apartments) and JBG Smith
AI system involved
RealPage Revenue Management Software

1 source article · read the reporting →

WF-53EQUB1 Jun 2019

Security Health Plan used AI to cut off nursing home care for 85-year-old woman

Frances Walter, an 85-year-old woman with a shattered shoulder, had her nursing home care payment cut off by Security Health Plan after an algorithm predicted she would recover in 16.6 days. The algorithm, nH Predict from NaviHealth, did not account for her severe pain and allergy to pain medicine. She was forced to spend her life savings and enroll in Medicaid while fighting the denial. A federal judge later ruled the denial was speculative and she was owed thousands of dollars.

Company involved
Security Health Plan
AI system involved
nH Predict

1 source article · read the reporting →

WF-P9E72631 Dec 2021

Greek Data Protection Authority fines Ministry of Migration and Asylum for AI surveillance systems

The Hellenic Data Protection Authority (HDPA) imposed an administrative fine of €175,000 on the Ministry of Migration and Asylum (MMA) for GDPR violations related to the 'Centaur' and 'Hyperion' programmes. These systems use AI behavioral analytics, CCTV, drones, and biometric data to monitor and control access to reception facilities for asylum seekers on Greek islands. The HDPA found that the MMA failed to conduct proper Data Protection Impact Assessments and did not cooperate with the authority. The MMA has been ordered to comply with GDPR within three months.

Company involved
Ministry of Migration and Asylum
AI system involved
Centaur and Hyperion programmes

10 source articles · read the reporting →

Meta Smart Glasses Lawsuit Claims Sex, Bathroom Footage Was Sent to Overseas AI Workers - Law Commentary

Recorded and transmitted private footage of users and bystanders to overseas AI workers

Company involved
Meta
AI system involved
Meta Smart Glasses

1 source article · read the reporting →

Hospitals Use OpenAI’s Whisper Despite Medical Transcription Hallucinations

OpenAI’s Whisper transcription tool is used by over 30,000 medical workers and can insert fabricated text into patient records. Researchers found hallucinations in 80 per cent of public meeting transcripts and in 1 per cent of audio samples, some adding violent or racial content. Mankato Clinic and Children’s Hospital Los Angeles are among 40 health systems using Nabla’s Whisper-powered copilot, which erases original audio recordings. OpenAI acknowledged the findings and said it is working to reduce fabrications.

Company involved
Mankato Clinic; Children’s Hospital Los Angeles
AI system involved
Whisper

2 source articles · read the reporting →

WF-04DJR81 Jun 2020

Kmart's facial recognition system for refund fraud found unlawful by Privacy Commissioner

Kmart Australia deployed facial recognition technology in 28 stores from June 2020 to July 2022, capturing biometric data of every customer entering the stores and those at returns counters to detect refund fraud. The system collected sensitive information without notifying customers or obtaining their consent. The Australian Privacy Commissioner found that Kmart breached the Privacy Act, as the exemption for unlawful activity did not justify the indiscriminate and disproportionate collection of biometric data from thousands of individuals. Kmart has ceased using the system and cooperated with the investigation.

Company involved
Kmart Australia Limited

7 source articles · read the reporting →

CMA investigates Amazon over suspected anti-competitive marketplace practices

The UK Competition and Markets Authority has opened an investigation into Amazon UK Marketplace, alleging that Amazon may be abusing a dominant position by using third-party seller data and favouring its own retail business or sellers using its logistics and delivery services. The investigation will examine how Amazon collects and uses seller data, how it sets criteria for the Buy Box, and how it determines Prime eligibility. The CMA stated it has not reached any conclusions and that the investigation focuses on potential harm to competition and consumers.

Company involved
Amazon

8 source articles · read the reporting →

← Newerpage 4 of 5Older →