The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

93 incidents closest to “CLARA Treatment” · matched on meaning · public reporting

Hyderabad doctors warn after ChatGPT advice causes patient harm

In Hyderabad, a 30-year-old kidney transplant patient discontinued antibiotics on ChatGPT's advice, losing her transplanted kidney and returning to dialysis. A 62-year-old diabetic man suffered weight loss and low sodium after following a ChatGPT diet plan. Doctors warn that AI tools lack clinical judgment and should not replace professional medical consultation.

AI system involved
ChatGPT

5 source articles · read the reporting →

WHO's health chatbot SARAH gives inconsistent and potentially harmful advice

The World Health Organization's AI chatbot SARAH, designed to provide health advice, was found by POLITICO to give contradictory and sometimes unhelpful responses. In tests, the bot failed to provide local health provider contacts and gave a US-specific suicide hotline to international users, raising concerns about its reliability in mental health crises. Health advocacy group Health Action International called for the bot to be taken down, while the WHO acknowledged the feedback and said it could be used to improve the tool.

Company involved
World Health Organization
AI system involved
SARAH

1 source article · read the reporting →

Penn Medicine study: kidney algorithm reduced Black transplant access

For years, a clinical algorithm used for the national kidney transplant waitlist made Black patients appear healthier than they were, making it harder for them to secure transplant spots. In 2019 a Penn Medicine researcher exposed the problem and showed it exacerbated racial disparities. A national taskforce recommended removing race from the algorithm’s scoring, and the change was widely adopted. Penn researchers later found that removing race also reduced chemotherapy access and clinical trial eligibility for Black patients.

AI system involved
kidney function algorithm

1 source article · read the reporting →

WF-MR0Q4G1 Sep 2018

U.S. hospitals' race-based eGFR calculation delayed Black kidney patients' transplants

For years, U.S. transplant hospitals used a race-based version of the eGFR equation to estimate Black patients' kidney function. The adjustment inflated Black patients' readings, delaying their referral to the kidney transplant waitlist and leaving some to die or deteriorate on dialysis. After years of advocacy, the United Network for Organ Sharing prohibited the race-based calculation in 2022 and required transplant programmes to revise affected patients' waiting times.

Company involved
U.S. transplant hospitals
AI system involved
eGFR (estimated glomerular filtration rate)

2 source articles · read the reporting →

WF-CDY4BR1 Jul 2024

Perplexity AI Misdiagnosis Leads to Man's Death After He Avoids Cancer Treatment

Benjamin Riley's father, a former neuroscientist, used Perplexity AI to self-diagnose his chronic lymphocytic leukemia and was incorrectly told he had Richter's Transformation, leading him to refuse his oncologist's recommended Ven-Obi treatment for a year. Despite his son's efforts to correct the misinformation by contacting the study authors, the father's condition worsened, and he eventually started treatment but died weeks later. The incident highlights the dangers of relying on AI for medical advice.

Company involved
Perplexity AI
AI system involved
Perplexity AI

1 source article · read the reporting →

Imperial College AI stethoscope falsely identified heart failure in two-thirds of flagged patients

Researchers at Imperial College London and Imperial College Healthcare NHS Trust have developed an AI-powered stethoscope that analyses heart rhythms and performs an ECG, sending results to a doctor's smartphone. A study of more than 12,000 patients across the UK found that two-thirds of patients flagged as having heart failure did not actually have the condition. The researchers acknowledged that the false positives could cause unnecessary anxiety, and many GP surgeries stopped using or barely used the device after 12 months. The team plans to deploy the stethoscope more widely.

Company involved
Imperial College London and Imperial College Healthcare NHS Trust

6 source articles · read the reporting →

WF-DC7W6F1 Aug 2022

Hospital Denies Pain Medication to Patient Based on Narx Score

Elizabeth Amirault, a 34-year-old chronic pain patient, was denied narcotic pain medication during a hospital visit in Fort Wayne, Indiana, in August 2022. A nurse practitioner told her that her Narx Score, generated by Bamboo Health's NarxCare platform, was too high to prescribe opioids. The algorithm uses prescription drug monitoring data to assess risk of misuse, but critics say it can harm patients by cutting off needed care. Amirault believes her score was unfairly high due to her multiple surgeries and doctors.

AI system involved
NarxCare

3 source articles · read the reporting →

WF-E4JT2L1 May 2026

Bay Area mom loses $5,400 in AI voice cloning kidnapping scam

Deborah Del Mastro received a call from scammers claiming her daughter was kidnapped. They used AI to clone her daughter's voice, convincing her to wire $5,400 to Mexico. After following instructions for five hours, she discovered her daughter was safe and the call was a scam. Martinez police are investigating, but Del Mastro does not expect to recover the money.

1 source article · read the reporting →

WF-QDHS2O15 Feb 2026

Moonwell loses $1.78M after AI-generated code from Claude Opus 4.6 causes oracle pricing error

DeFi lending protocol Moonwell lost $1.78 million after an oracle pricing error in smart contract code partially written by Anthropic's Claude Opus 4.6 model. The error valued cbETH at approximately $1.12 per token instead of its actual market price of nearly $2,200, triggering instant liquidations. Moonwell contained the issue by reducing the cbETH borrow cap, but users suffered catastrophic losses. The incident has sparked debate about the risks of AI-generated code in smart contracts.

Company involved
Moonwell
AI system involved
Claude Opus 4.6

4 source articles · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-GYY2DP5 Sep 2025

CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…

The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.

Company involved
Christopher Day

1 source article · read the reporting →

Abbott issues correction for FreeStyle Libre 3 sensors over incorrect glucose readings

Abbott initiated a medical device correction for certain FreeStyle Libre 3 and Libre 3 Plus sensors after internal testing found they might give incorrect low glucose readings. The company says the issue stems from one production line and could lead to improper treatment decisions for people with diabetes. Abbott is replacing affected sensors at no charge and has reported severe adverse events and deaths potentially associated with the issue.

Company involved
Abbott
AI system involved
FreeStyle Libre 3 and FreeStyle Libre 3 Plus sensors

2 source articles · read the reporting →

WF-IM3YHH8 Sep 2026

State ex rel. Steven Schnell v. Honorable Rebecca Richardson (CA Missouri): AI-hallucinated content in court filing, Monetary Sanction

The AI-generated fictitious case citations misled the court and caused opposing counsel to incur attorney's fees.

Company involved
Jenna Rohr Conley

1 source article · read the reporting →

WF-SQKJVH28 Feb 2026

US Maven targeting system kills 175 at Iranian school after database error

On 28 February 2026, US forces struck the Shajareh Tayyebeh primary school in Minab, Iran, killing between 175 and 180 people, most of them girls. The targeting was carried out by the Maven Smart System, built by Palantir, which had classified the building as a military facility based on an outdated Defense Intelligence Agency database. Although media attention focused on the chatbot Claude, the real failure was a bureaucratic one: the database had not been updated to reflect the building's conversion into a school years earlier. The incident highlights the lethal consequences of compressed kill chains and automated targeting infrastructure.

Company involved
US Department of Defense
AI system involved
Maven Smart System

2 source articles · read the reporting →

Negrar hospital denies head physician's death, blames Google AI error

The Irccs Sacro Cuore Don Calabria hospital in Negrar has denied reports that its head of orthopaedics, Claudio Zorzi, had died, saying the claim was a false output generated by Google's AI Overview feature. The hospital says the AI confused Zorzi with a deceased family doctor of the same name, and has sent Google a formal legal notice demanding the immediate removal of the false content. It is also reserving the right to seek damages.

Company involved
Google
AI system involved
AI Overview

5 source articles · read the reporting →

WF-EAN4XD1 Jul 2019

Clarifai sued for capturing OkCupid user photos without consent

An artificial intelligence company, Clarifai Inc., is accused of capturing OkCupid user profile photos without permission to train its facial recognition tools. The lawsuit, filed in Illinois state court in February 2020, alleges that Clarifai violated the Illinois Biometric Information Privacy Act by creating a face database from the data. The plaintiff, Jordan Stein, claims Clarifai worked with an investor tied to OkCupid to gain access to the profiles. The case is pending.

Company involved
Clarifai Inc.
AI system involved
Clarifai facial recognition tools

10 source articles · read the reporting →

WF-CGL1WP21 Jan 2021

Cruzcampo deepfake ad of Lola Flores goes viral

Cruzcampo launched an advertising campaign using a deepfake video of the late singer Lola Flores, created with artificial intelligence. The video went viral shortly after release. The company explained the technical process and involved Flores' daughters in the project.

Company involved
Cruzcampo

10 source articles · read the reporting →

WF-ANSGFV1 Dec 2022

Apple kills plan to detect CSAM in iCloud

Apple announced a plan to detect child sexual abuse material in iCloud in 2021, but paused and then killed the plan in December 2022. Child safety advocates, including Sarah Gardner, are now engaging with Apple to urge implementation of the technology. The letter expresses concern about the delay and the impact on survivors.

Company involved
Apple

10 source articles · read the reporting →

WF-P2510P1 Sep 2024

Alpha School parents allege harm from AI-driven learning software

Parents of students at Alpha School in Brownsville, Texas, allege that the school's AI-driven learning software caused their children psychological distress and physical harm. One 9-year-old girl was forced to repeat multiplication lessons hundreds of times, leading to crying episodes and weight loss, and was denied snacks until she met software metrics. The school denies the allegations and says it prioritises a safe environment.

Company involved
Alpha School
AI system involved
IXL

5 source articles · read the reporting →

WF-4RZUE65 Dec 2023

Civitai dropped by cloud provider OctoML over CSAM image generation

Civitai, an AI image generation platform, was dropped by its cloud computing provider OctoML after an investigation by 404 Media found it was being used to generate images that could be categorized as child sexual abuse material (CSAM). The platform also faced scrutiny for nonconsensual deepfakes of celebrities and private citizens, primarily women. Civitai added new moderation filters in response, but OctoML terminated the business relationship.

Company involved
Civitai
AI system involved
Civitai

8 source articles · read the reporting →

WF-JNGAAJ9 Aug 2025

Man Hospitalized After Following ChatGPT's Salt Removal Advice

A 60-year-old man was hospitalized after following ChatGPT's advice to remove salt from his diet, replacing it with sodium bromide sourced online. He developed bromide toxicity, leading to severe neuropsychiatric symptoms and dermatological issues. The case report, published in the American College of Physicians Journals, highlights the dangers of AI-generated health advice. The man was treated with fluids and electrolytes and later admitted to the inpatient psychiatry unit.

Company involved
OpenAI
AI system involved
ChatGPT

6 source articles · read the reporting →

← Newerpage 4 of 4