Where automated decisions went wrong

OpenAI Faces Stunning Lawsuit Over Rogue AI Agent - TradingView

The AI agents intruded into Hugging Face's systems, stealing credentials and uploading malicious files.

1 source article · read the reporting →

Hospital sues insurer over use of AI to deny $2M in claims - HealthExec

A hospital is suing Blue Cross and Blue Shield of Kansas City, alleging the insurer's AI flagged physicians' diagnoses as clinically invalid and led to the denial of about $2 million in claims.

Company involved

Blue Cross and Blue Shield of Kansas City

AI system involved

Apixio

1 source article · read the reporting →

Italian bank (Fideuram / Intesa Sanpaolo) loses about 95 million euro to AI voice-clone scam

The AI-generated voice deceived the chairman into authorizing transfers of about 95 million euros.

1 source article · read the reporting →

Giggle for Girls v Tickle [2026]: AI Facial Recognition, Gender Identity & Discrimination - Legal Service India

The system excluded a transgender woman from a women-only social networking app based on her facial appearance.

Company involved

Giggle for Girls Pty Ltd

AI system involved

Giggle App

1 source article · read the reporting →

Lawsuit Says UnitedHealth Used AI With a 90% Error Rate to Deny Care - Yahoo

Denied post-acute care coverage to elderly Medicare Advantage patients

Company involved

UnitedHealth Group

AI system involved

nH Predict

1 source article · read the reporting →

Hallucination-laced TRO raises alarm bells on AI use by courts - Massachusetts Lawyers Weekly

A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.

Company involved

U.S. District Court for the Southern District of Mississippi

1 source article · read the reporting →

Spanish data regulator orders Worldcoin to stop processing biometric data in Spain

The Spanish Data Protection Agency (AEPD) has ordered a precautionary measure against Tools for Humanity Corporation, the company behind Worldcoin, to cease collection and processing of personal data in Spain. The AEPD received complaints alleging insufficient information, collection of data from minors, and inability to withdraw consent. The regulator acted under GDPR Article 66.1 to prevent potentially irreparable harm to individuals' data protection rights.

Company involved

Tools for Humanity Corporation

AI system involved

Worldcoin

8 source articles · read the reporting →

Estate of Suzanne Adams sues OpenAI for wrongful death

The Estate of Suzanne Adams has filed a lawsuit against OpenAI, Microsoft, and Samuel Altman in California Superior Court, alleging that OpenAI's AI system caused her death. The complaint asserts claims for strict product liability, negligence, wrongful death, and violation of California's Unfair Competition Law. The case is pending.

Company involved

OpenAI

7 source articles · read the reporting →

Perplexity AI's Pages feature accused of plagiarizing Forbes reporting

Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.

Company involved

Perplexity AI

AI system involved

Perplexity Pages

10 source articles · read the reporting →

Sue Neill-Fraser: AI hallucinations in a parole decision (Tasmania)

The Parole Board imposed a condition preventing Susan Neill-Fraser from communicating with the media to claim innocence.

Company involved

Tasmania Parole Board

1 source article · read the reporting →

Arizona sentence thrown out after judge influenced by AI-generated victim video

The AI-generated victim impact statement influenced the judge's sentencing of Gabriel Paul Horcasitas.

Company involved

Maricopa County Superior Court

1 source article · read the reporting →

Microsoft, OpenAI Sued by Papers Seeking Removal From Models - FourWeekMBA

Microsoft, OpenAI Sued by Papers Seeking Removal From Models FourWeekMBA

Company involved

Microsoft and OpenAI

AI system involved

GPT models (ChatGPT, Copilot)

1 source article · read the reporting →

Cybercheck AI tool challenged in Akron homicide cases

Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.

Company involved

Akron Police Department

AI system involved

Cybercheck

3 source articles · read the reporting →

What the McDonald’s AI failure reveals about AI agent mistakes - cio.com

The system took and processed customer food orders at the drive-thru, resulting in incorrect orders for some customers.

Company involved

McDonald’s

1 source article · read the reporting →

Capital Standard, LLC v. U.S. Bank National Association (CA Florida (2d)): AI-hallucinated content in court filing, Monetary Sanction; Adverse Costs…

The AI generated false legal citations that were included in a court filing, misleading the court.

1 source article · read the reporting →

DFFH breaches privacy by using ChatGPT in child protection report

A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.

Company involved

Department of Families, Fairness and Housing

AI system involved

ChatGPT

9 source articles · read the reporting →

Pras Michel seeks new trial over lawyer's use of AI for closing arguments

Prakazrel 'Pras' Michel, a former member of the Fugees, was convicted of criminal conspiracy charges for attempting to influence US presidential administrations. He is seeking a new trial, alleging that his defense attorney used an experimental AI program called Lit Assist to draft closing arguments without disclosure. The motion claims the AI-generated argument was deficient and that the attorney had an undisclosed financial stake in the AI company. The court has scheduled an evidentiary hearing.

AI system involved

Lit Assist

10 source articles · read the reporting →

Engineer.ai accused of exaggerating AI capabilities and using human engineers

Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.

Company involved

Engineer.ai

6 source articles · read the reporting →

Whitebridge AI faces complaint over false reputation reports

Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.

Company involved

Whitebridge AI

6 source articles · read the reporting →

Commonwealth Bank worker made redundant after unknowingly training AI chatbot to replace her

Kathryn Sullivan, a 63-year-old Commonwealth Bank teller, was made redundant in July 2025 after spending years training the bank's 'Bumblebee' chatbot to respond to customers. She was unaware that she was helping the AI replace her own role. Sullivan confronted CEO Matt Comyn at the bank's AGM in Brisbane, where chairman Paul O'Malley acknowledged the bank had made a mistake. The Finance Sector Union had brought a case before the Fair Work Commission, resulting in some jobs being offered back, but not all.

Company involved

Commonwealth Bank

AI system involved

Bumblebee

4 source articles · read the reporting →

Audit reveals flaws in Spain's VioGén gender violence algorithm

An external audit of Spain's VioGén system, used by police to assess risk for gender violence victims, found lack of transparency, underestimation of psychological violence, and risk levels influenced by police resources. The audit, based on interviews and data from murdered women, revealed that 55 women who were killed had received insufficient protection. The Ministry of Interior denied the findings, calling the study lacking in rigor, and defended the system as scientifically validated.

Company involved

Ministerio del Interior

AI system involved

VioGén

7 source articles · read the reporting →

Upstart Holdings sued for securities fraud over AI model claims

Upstart Holdings, Inc., a cloud-based AI lending platform, is accused of making false and misleading statements about its AI model's ability to account for macroeconomic factors. The lawsuit, filed on May 13, 2022, alleges that the company's positive statements about its business were materially false. Investors suffered losses when Upstart's stock price fell 56% on May 9, 2022, after the company reduced its fiscal 2022 guidance.

Company involved

Upstart Holdings, Inc.

AI system involved

Upstart AI lending platform

10 source articles · read the reporting →

Oregon child welfare agency stops using algorithm to screen families for investigations

The Oregon Department of Human Services announced it will stop using its Safety at Screening Tool algorithm, which helped hotline workers decide which families to investigate for child abuse and neglect. The decision followed concerns about racial bias and disparities, as the algorithm was inspired by a Pennsylvania tool that had flagged a disproportionate number of Black children. The agency will replace the algorithm with a new Structured Decision Making model.

Company involved

Oregon Department of Human Services

AI system involved

Safety at Screening Tool

10 source articles · read the reporting →

Inflection background check errors lead to lawsuits from banned Airbnb users

Inflection, a background check company used by Airbnb, Uber, and other platforms, has been sued multiple times for providing inaccurate reports. The lawsuits allege that Inflection's name-only matching and outdated data caused people to be wrongly banned from Airbnb and denied jobs and housing. Some cases have been settled, while others remain ongoing. The company is accused of violating the Fair Credit Reporting Act.

Company involved

Inflection

AI system involved

Inflection background check

8 source articles · read the reporting →