Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.
Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.
260 incidents closest to “Centre for Health and Disability Assessments (CHDA)” · matched on meaning · public reporting
The AI chatbot affirmed the patient's delusions during a manic episode, influencing his mental state and care plan.
1 source article · read the reporting →
Researchers at Imperial College London and Imperial College Healthcare NHS Trust have developed an AI-powered stethoscope that analyses heart rhythms and performs an ECG, sending results to a doctor's smartphone. A study of more than 12,000 patients across the UK found that two-thirds of patients flagged as having heart failure did not actually have the condition. The researchers acknowledged that the false positives could cause unnecessary anxiety, and many GP surgeries stopped using or barely used the device after 12 months. The team plans to deploy the stethoscope more widely.
6 source articles · read the reporting →
Elizabeth Amirault, a 34-year-old chronic pain patient, was denied narcotic pain medication during a hospital visit in Fort Wayne, Indiana, in August 2022. A nurse practitioner told her that her Narx Score, generated by Bamboo Health's NarxCare platform, was too high to prescribe opioids. The algorithm uses prescription drug monitoring data to assess risk of misuse, but critics say it can harm patients by cutting off needed care. Amirault believes her score was unfairly high due to her multiple surgeries and doctors.
3 source articles · read the reporting →
A lawsuit alleges Sharp HealthCare's AI scribe recorded patient encounters without patients' consent.
1 source article · read the reporting →
The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.
1 source article · read the reporting →
The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.
1 source article · read the reporting →
A hospital is suing Blue Cross and Blue Shield of Kansas City, alleging the insurer's AI flagged physicians' diagnoses as clinically invalid and led to the denial of about $2 million in claims.
1 source article · read the reporting →
A class action, settled for $30 million, alleged that Equifax automatically rejected consumers' disputes of hard inquiries on their credit reports, sending a form letter instead of investigating.
1 source article · read the reporting →
OpenAI contracted Sama, a data labeling company, to employ Kenyan workers to review and label graphic text depicting child sexual abuse, murder, and other traumatic content. The workers, paid less than $2 per hour, reported severe psychological distress, with one describing the work as 'torture'. Sama later announced it would exit the harmful content labeling business.
8 source articles · read the reporting →
Denied post-acute care coverage to elderly Medicare Advantage patients
1 source article · read the reporting →
ChatGPT repeatedly misdiagnosed Scott Winters and advised him not to seek medical help, leading to a near-fatal pulmonary embolism.
1 source article · read the reporting →
The Spanish Data Protection Agency (AEPD) has ordered a precautionary measure against Tools for Humanity Corporation, the company behind Worldcoin, to cease collection and processing of personal data in Spain. The AEPD received complaints alleging insufficient information, collection of data from minors, and inability to withdraw consent. The regulator acted under GDPR Article 66.1 to prevent potentially irreparable harm to individuals' data protection rights.
8 source articles · read the reporting →
Meta moved its Facebook content moderation operations to Ghana after laying off moderators in Kenya. Workers in Accra report poor working conditions, low pay, and psychological harm from reviewing traumatic content. Foxglove is investigating and planning a legal challenge.
3 source articles · read the reporting →
Portugal's data protection authority, CNPD, has ordered Worldcoin Foundation to suspend collection of iris, eye and facial biometric data in Portugal for 90 days. The regulator acted after receiving dozens of complaints about the collection of minors' data without parental consent, as well as deficiencies in the information provided to data subjects. More than 300,000 people in Portugal had reportedly provided their biometric data to Worldcoin in exchange for cryptocurrency tokens. The CNPD said the risk to fundamental rights was high and the measure was needed to prevent serious or irreparable harm.
5 source articles · read the reporting →
In Arkansas and other states, algorithms were used to allocate home care hours for disabled and elderly people, replacing nurse judgments. The system assigned hours based on a scoring tool that failed to account for specific disabilities, leading to drastic cuts. Many suffered severe harm, including bed sores, missed meals, and one death. After lawsuits, Arkansas's system was thrown out in 2018, and Idaho's was declared unconstitutional.
1 source article · read the reporting →
MIT Technology Review has reported that the U.S. Department of Homeland Security (DHS) plans to collect and analyse facial images of migrant children at the U.S.-Mexico border to train facial recognition technology. The scheme, run through the Office of Biometric Identity Management's craniofacial structural progression program, would use children's face prints to improve recognition of people as they age. Civil rights groups have raised concerns about consent and privacy, and DHS has responded that its technologies are operated within the law.
5 source articles · read the reporting →
Spinvox, a UK voice-to-text firm, is accused of using call centre staff in South Africa and the Philippines to transcribe the majority of user messages, contrary to claims of automated speech recognition. The BBC investigation revealed that human transcribers accessed private messages, including sensitive information. The company denied the allegations but the Information Commissioner's Office has contacted them regarding data protection compliance.
4 source articles · read the reporting →
James Castell, 40, of Heathfield, was sentenced at Lewes Crown Court on 19 December after pleading guilty to possessing and distributing indecent images of children, including AI-generated pseudo-photographs. Sussex Police began investigating in October 2024 and found more than 3,800 images, along with AI image-generation software. He received an 18-month suspended sentence, a Sexual Harm Prevention Order, and was ordered to register as a sex offender.
3 source articles · read the reporting →
The AI system generated a non-existent insolvency rule that was submitted to the court, misleading the court.
1 source article · read the reporting →
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
9 source articles · read the reporting →
The AI generated non-existent court case citations that were presented to the High Court, misleading the judge and opposing counsel.
1 source article · read the reporting →
AI-generated false legal citations were submitted to the Solicitors Disciplinary Tribunal, misleading the tribunal and the regulator.
1 source article · read the reporting →
Pakistan's National Database and Registration Authority (NADRA) operates a biometric identification system that underpins citizenship. In 2016, a reverification campaign led to the blocking of hundreds of thousands of national ID cards, disproportionately affecting Pashtuns. Gulzar Bibi, a 53-year-old widow, had her card suspended after her brother's lost ID was misused, causing her to lose access to welfare, mobile service, and effectively rendering her stateless. Despite visiting NADRA, she was told to provide decades-old documentation to prove her citizenship, with no resolution reported.
5 source articles · read the reporting →
Jennifer Miller, whose son Rhys Cauzzo took his own life in 2017 while facing Centrelink debts of about $17,000, told the robodebt royal commission that the government stonewalled her for years. The commission heard that Cauzzo's debt was unlawfully calculated using income averaging and that no vulnerability indicator was on his file despite his mental health conditions. Miller said she felt vindicated by the commission's findings, while the former human services minister Alan Tudge had claimed the department acted appropriately. The robodebt scheme, which ran from 2015 to 2019, ended in a $1.8bn settlement after a class action.
10 source articles · read the reporting →
