The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Provenir AI Decisioning Platform” · matched on meaning · public reporting

WF-PP8VI21 Feb 2023

AI weeds out older and minority job applicants, lawsuit against Workday claims

Job applicants were automatically screened out by AI, allegedly discriminating against older, minority, and disabled applicants.

Company involved
Workday
AI system involved
Workday AI recruiting tools

1 source article · read the reporting →

AI Hiring Platform Faces FCRA Class Action Over Data Use | Kistler et al. v. Eightfold AI Inc.

The AI platform screened job applicants, affecting their hiring prospects.

Company involved
Eightfold AI
AI system involved
Eightfold AI

1 source article · read the reporting →

WF-7XGUUORussian

AI rejected a job candidate — and no one explained why. A look at how it works

ИИ отказал кандидату в работе — и никто не объяснил почему. Разбираем, как это устроено - Sostav.ru

In 2026, AI-driven recruitment systems often automatically reject candidates without human review. Algorithms scan resumes, rank applicants, and send template rejections to those who don't score high enough, while recruiters typically only see the top-ranked profiles. The criteria used by these systems are often opaque, and many managers cannot explain the logic behind the AI's decisions.

1 source article · read the reporting →

WF-XT66PD1 Jan 2026

AI Lawsuit Pushes the Boundaries of AI Litigation—and May Signal a New Wave

Ranked job applicants' likelihood of success, affecting their hiring prospects.

Company involved
Eightfold AI Inc.
AI system involved
Eightfold AI Hiring Platform

1 source article · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

WF-5QN9B62 Jun 2026

Federal Court: Barron v BT Funds AI Pleading Denied as 'AI Slop' - Wansom AI

The Federal Court denied leave to file an AI-generated pleading, delaying the applicant's case.

1 source article · read the reporting →

WF-YYDECKJapanese

US Federal Court Rejects Workday's Arguments, Allows AI Hiring Lawsuit to Proceed

米連邦地裁がWorkdayの主張を退け、AI採用訴訟の継続を認める - Межа. Новини України.

A federal court in San Francisco declined Workday's request to dismiss a lawsuit alleging its AI-powered hiring software discriminates against applicants with disabilities and other protected groups. Judge Rita Lin ruled that California anti-discrimination law may apply and allowed claims that the software screens candidates using proxy indicators such as employment gaps to move forward. Workday maintains its tools evaluate only qualifications and do not make hiring decisions.

Company involved
Workday
AI system involved
Workday

1 source article · read the reporting →

AI-Generated Fake Investment Websites Target Australian Fraud Analyst

A fraud analyst, Leon, was targeted by scammers who used AI to create convincing fake websites for non-existent investment firms. The scammers posed as employees of Assent Advisory and directed him to elaborate sites for APPC Capital Singapore and Thackeray Mines and Minerals Inc., complete with AI-generated images and fake details. Leon recognised the scam, but the sophistication of the AI-generated content made him second-guess his own judgment. The incident highlights how AI is enabling more convincing investment scams.

1 source article · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

FTC Orders Evolv to Stop Overstating Effectiveness of AI Gun Detection Tech

Evolv, a company selling AI-powered weapons detection systems, has been ordered by the FTC to stop making misleading claims about its Evolv Express product. The FTC alleged that the technology is essentially a metal detector with unproven AI, and that Evolv falsely claimed it could detect guns while ignoring harmless items. A pilot in New York City subways resulted in over 100 false positives and no guns detected. The settlement requires Evolv to allow educational customers to cancel their contracts and prohibits further misrepresentations.

Company involved
Evolv
AI system involved
Evolv Express

2 source articles · read the reporting →

WF-7U35ZD18 Mar 2024

SEC Charges Delphia and Global Predictions for False AI Claims

The SEC charged Delphia (USA) Inc. and Global Predictions Inc. for making false and misleading statements about their use of artificial intelligence. Delphia claimed from 2019 to 2023 that it used AI and machine learning to predict investments, while Global Predictions falsely claimed in 2023 to be the 'first regulated AI financial advisor'. Both firms settled the charges without admitting or denying the findings, agreeing to pay a total of $400,000 in civil penalties and to cease and desist from further violations.

Company involved
Delphia (USA) Inc. and Global Predictions Inc.

1 source article · read the reporting →

AI chatbots found giving inaccurate financial advice to UK consumers

A Which? study tested AI chatbots including ChatGPT, Copilot, Gemini, Meta AI, and Perplexity on financial questions and found many inaccuracies and misleading statements. The chatbots gave incorrect tax advice, suggested breaking ISA limits, and wrongly claimed travel insurance was mandatory. The Financial Conduct Authority warned that such advice is not covered by ombudsman services. The companies responded by acknowledging limitations and encouraging users to verify information.

Company involved
Meta, OpenAI, Microsoft, Google, Perplexity
AI system involved
Meta AI, ChatGPT, Copilot, Gemini, Perplexity

1 source article · read the reporting →

WF-P5TD2E1 Nov 2023

CMS warns insurers against using AI to deny Medicare Advantage care

The Centers for Medicare & Medicaid Services (CMS) clarified that health insurers cannot use algorithms or AI to deny care to Medicare Advantage members. This follows lawsuits alleging UnitedHealth and Humana used an AI tool, nH Predict, to wrongfully deny post-acute care to elderly patients. The tool reportedly produced rigid estimates ignoring individual patient needs, leading to premature denials. CMS warned that non-compliance could result in penalties and increased audits.

Company involved
UnitedHealth, Humana
AI system involved
nH Predict

10 source articles · read the reporting →

WF-NEQ6XV20 Mar 2018

Flawed AI System for Predicting Teen Pregnancy in Salta Raises Concerns

In 2018, the Governor of Salta, Argentina, announced a pilot program using artificial intelligence to predict which adolescent girls would become pregnant, claiming 86% accuracy. Researchers at the Laboratorio de Inteligencia Artificial Aplicada found serious methodological errors, including data leakage that inflated accuracy and the use of inadequate survey data. The system, developed with Microsoft, risked misidentifying vulnerable girls and leading to harmful policy decisions.

Company involved
Ministerio de Primera Infancia de Salta

4 source articles · read the reporting →

WF-PS4WFM18 Mar 2023

DOGE's Flawed AI Tool Threatens Veterans Affairs Services

The Department of Government Efficiency developed an AI tool to identify unnecessary VA contracts, but it used outdated models and lacked context, leading to misclassification. At least 24 contracts were canceled, affecting cancer research and nurse care tools. The VA acknowledged the tool's role but stated all contracts undergo human review. Experts criticized the use of AI for such complex decisions.

Company involved
Department of Veterans Affairs
AI system involved
Muncher

2 source articles · read the reporting →

UK government using AI for benefits and immigration decisions

The UK government is reportedly using artificial intelligence to make decisions on welfare benefits and immigration applications. The system automates decisions previously made by human caseworkers. Concerns have been raised about the fairness and transparency of such automated decisions.

10 source articles · read the reporting →

Predictim AI babysitter screening raises accuracy and bias concerns

Jessie Battaglia used Predictim, an online service that claims to use AI to assess babysitters' risk of drug abuse, bullying, or bad attitude. The service analyzes social media profiles and other online data. Experts have raised concerns about the accuracy and potential bias of the AI assessments. Predictim's CEO defended the service, saying it provides additional information for parents.

Company involved
Predictim
AI system involved
Predictim

10 source articles · read the reporting →

WF-VEH8PJ1 Jan 2024

Nippon Life Sues OpenAI Alleging ChatGPT Engaged in Unauthorized Practice of Law

Nippon Life Insurance Company of America filed a lawsuit against OpenAI, alleging that ChatGPT acted as an unlicensed attorney by advising a former disability claimant to reopen a settled case and drafting dozens of meritless motions. The insurer claims the AI's actions constitute unauthorized practice of law under Illinois statute and seeks $300,000 in compensatory damages. OpenAI has denied the allegations, calling the complaint meritless. The case is pending in federal court in Chicago.

Company involved
OpenAI
AI system involved
ChatGPT

2 source articles · read the reporting →

Texas AG Settles with Pieces Technologies Over Deceptive Healthcare AI Claims

The Texas Attorney General investigated Pieces Technologies, a Dallas-based healthcare AI company, for making false and misleading statements about the accuracy of its generative AI product used in hospitals. The company claimed an error rate of less than 1 per 100,000, but the investigation found these metrics were likely inaccurate. As part of the settlement, Pieces agreed to accurately disclose its product's accuracy and ensure hospital staff understand the appropriate reliance on its AI. The case marks the first-of-its-kind healthcare generative AI investigation by the AG.

Company involved
Pieces Technologies

4 source articles · read the reporting →

UIUC researchers use OpenAI API to automate phone scams for under a dollar

Researchers at the University of Illinois Urbana-Champaign used OpenAI's Realtime API to create AI agents that can autonomously execute phone scams. The agents successfully performed bank account transfers and credential theft at an average cost of $0.75 per scam. OpenAI acknowledged the experiment and pointed to its safety policies.

Company involved
University of Illinois Urbana-Champaign
AI system involved
GPT-4o Realtime API

6 source articles · read the reporting →

Finnish recruitment company Digital Minds used AI to analyze job applicants' messages, prompting data protection investigation

Digital Minds, a Finnish recruitment company founded by psychologists, used IBM Watson AI to analyze job applicants' social media and email messages for personality assessments. The company obtained written consent but the Finnish Data Protection Ombudsman launched an investigation, suspecting violations of data protection laws and the secrecy of correspondence. The service was used on fewer than ten applicants and has been paused pending the investigation.

Company involved
Digital Minds
AI system involved
IBM Watson

9 source articles · read the reporting →

WF-VU5D658 Apr 2023

California regulator accuses Maxpread Technologies of using AI-generated fake CEO to scam investors

Maxpread Technologies allegedly used an AI-generated avatar to pose as its CEO in a YouTube video to deceive investors. The California DFPI issued cease and desist letters to Maxpread and four other companies for offering unqualified securities and making false promises. The regulator claims the companies promised high daily returns using AI trading, but these claims were false. Maxpread did not respond to requests for comment.

Company involved
Maxpread Technologies

8 source articles · read the reporting →

UnitedHealthcare sued for using AI to deny Medicare Advantage patients care

A class action complaint alleges that UnitedHealthcare and its subsidiary naviHealth deployed an artificial intelligence model to override treating physicians' determinations of medically necessary care for elderly Medicare Advantage patients. The complaint claims the AI model has a known 90% error rate and wrongfully denied patients care. The lawsuit, filed in the U.S. District Court for the District of Minnesota, seeks damages on behalf of the estates of two deceased patients and all others similarly situated.

Company involved
UnitedHealthcare, Inc.

10 source articles · read the reporting →

Kaedim used human artists instead of AI for 3D model generation

Kaedim, an AI startup that claimed to use machine learning to convert 2D illustrations into 3D models, actually used human artists to produce the models, according to sources. The company's founder was featured in Forbes 30 Under 30 for the technology. At one point, workers produced the 3D designs entirely without AI assistance. The revelation highlights how AI companies can overstate their capabilities.

Company involved
Kaedim
AI system involved
Kaedim

10 source articles · read the reporting →

page 1 of 2Older →