The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Provenir Decision Intelligence” · matched on meaning · public reporting

WF-PP8VI21 Feb 2023

AI weeds out older and minority job applicants, lawsuit against Workday claims

Job applicants were automatically screened out by AI, allegedly discriminating against older, minority, and disabled applicants.

Company involved
Workday
AI system involved
Workday AI recruiting tools

1 source article · read the reporting →

AI detector scores banned as evidence at Yale and Johns Hopkins, vendor conflict exposed - Pasquale Pillitteri

The system flagged student assignments as AI-generated, potentially leading to academic misconduct accusations.

Company involved
Yale University and Johns Hopkins University
AI system involved
Turnitin AI detector

1 source article · read the reporting →

WF-50B5GS19 Mar 2025EN

Intuit, HireVue Accused of AI Job Bias Against Deaf Woman

The ACLU filed complaints with state and federal agencies on behalf of a deaf, Indigenous employee of Intuit who was denied a promotion after an automated HireVue video interview. The tool did not caption all audible questions and could not accurately transcribe her speech, which the complaint says disadvantaged her because of her disability and race.

Company involved
Intuit
AI system involved
HireVue video interview

1 source article · read the reporting →

WF-NHFAIT28 Jul 2026EN

Job seeker asks First Circuit to revive class action over AI interviewing tool

Massachusetts financial consultant Mozart Saint Cyr leads a proposed class of job applicants who say JPMorgan Chase's use of HireVue one-way video interviews amounted to a lie detector test banned by state law. After a federal judge dismissed the case, they asked the First Circuit to revive it.

Company involved
JPMorgan Chase
AI system involved
HireVue one-way video interview

1 source article · read the reporting →

Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News

Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News

1 source article · read the reporting →

AI Hiring Platform Faces FCRA Class Action Over Data Use | Kistler et al. v. Eightfold AI Inc.

The AI platform screened job applicants, affecting their hiring prospects.

Company involved
Eightfold AI
AI system involved
Eightfold AI

1 source article · read the reporting →

WF-XT66PD1 Jan 2026

AI Lawsuit Pushes the Boundaries of AI Litigation—and May Signal a New Wave

Ranked job applicants' likelihood of success, affecting their hiring prospects.

Company involved
Eightfold AI Inc.
AI system involved
Eightfold AI Hiring Platform

1 source article · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

WF-5QN9B62 Jun 2026

Federal Court: Barron v BT Funds AI Pleading Denied as 'AI Slop' - Wansom AI

The Federal Court denied leave to file an AI-generated pleading, delaying the applicant's case.

1 source article · read the reporting →

WF-YYDECKJapanese

US Federal Court Rejects Workday's Arguments, Allows AI Hiring Lawsuit to Proceed

米連邦地裁がWorkdayの主張を退け、AI採用訴訟の継続を認める - Межа. Новини України.

A federal court in San Francisco declined Workday's request to dismiss a lawsuit alleging its AI-powered hiring software discriminates against applicants with disabilities and other protected groups. Judge Rita Lin ruled that California anti-discrimination law may apply and allowed claims that the software screens candidates using proxy indicators such as employment gaps to move forward. Workday maintains its tools evaluate only qualifications and do not make hiring decisions.

Company involved
Workday
AI system involved
Workday

1 source article · read the reporting →

WF-4CTZ7A15 Oct 2021

Allen Institute's Ask Delphi AI Delivers Racist Ethical Judgments

Allen Institute for AI launched a research prototype called Ask Delphi that gives ethical advice. Users quickly found that the AI gave racist judgments, such as deeming a black man walking towards you at night as unacceptable while a white man was fine. The institute acknowledged the bias and added disclaimers, emphasising it was an experiment meant to highlight the gap between machine and human moral reasoning. Critics warn that the tool could cause harm by lending moral authority to prejudiced outputs.

Company involved
Allen Institute for AI
AI system involved
Ask Delphi

3 source articles · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

WF-7U35ZD18 Mar 2024

SEC Charges Delphia and Global Predictions for False AI Claims

The SEC charged Delphia (USA) Inc. and Global Predictions Inc. for making false and misleading statements about their use of artificial intelligence. Delphia claimed from 2019 to 2023 that it used AI and machine learning to predict investments, while Global Predictions falsely claimed in 2023 to be the 'first regulated AI financial advisor'. Both firms settled the charges without admitting or denying the findings, agreeing to pay a total of $400,000 in civil penalties and to cease and desist from further violations.

Company involved
Delphia (USA) Inc. and Global Predictions Inc.

1 source article · read the reporting →

Sound Intelligence Aggression Detectors Prove Unreliable in School Tests

ProPublica tested Sound Intelligence's aggression detection software, used in hundreds of U.S. schools and hospitals. The algorithm, which analyzes audio for signs of stress and anger, frequently misidentified innocent sounds like coughing as aggressive and failed to detect actual screams. At a New Jersey hospital, the system ignored an agitated man screaming and pounding a desk, escalating the situation. Sound Intelligence's CEO acknowledged the imperfections but defended the technology as an early warning system.

AI system involved
Sound Intelligence aggression detector

2 source articles · read the reporting →

WF-JLBJ8B5 Nov 2025

Amazon sends cease-and-desist to Perplexity over AI shopping agent

Amazon sent a cease-and-desist letter to Perplexity, alleging that its Comet AI browser violates Amazon's terms of service by making purchases on behalf of users without disclosing its automated nature. Perplexity responded by calling the legal threat 'bullying' and argued that its bot does not need to identify itself. The dispute highlights tensions between AI agents and e-commerce platforms.

Company involved
Perplexity
AI system involved
Comet

5 source articles · read the reporting →

WF-P5TD2E1 Nov 2023

CMS warns insurers against using AI to deny Medicare Advantage care

The Centers for Medicare & Medicaid Services (CMS) clarified that health insurers cannot use algorithms or AI to deny care to Medicare Advantage members. This follows lawsuits alleging UnitedHealth and Humana used an AI tool, nH Predict, to wrongfully deny post-acute care to elderly patients. The tool reportedly produced rigid estimates ignoring individual patient needs, leading to premature denials. CMS warned that non-compliance could result in penalties and increased audits.

Company involved
UnitedHealth, Humana
AI system involved
nH Predict

10 source articles · read the reporting →

WF-NEQ6XV20 Mar 2018

Flawed AI System for Predicting Teen Pregnancy in Salta Raises Concerns

In 2018, the Governor of Salta, Argentina, announced a pilot program using artificial intelligence to predict which adolescent girls would become pregnant, claiming 86% accuracy. Researchers at the Laboratorio de Inteligencia Artificial Aplicada found serious methodological errors, including data leakage that inflated accuracy and the use of inadequate survey data. The system, developed with Microsoft, risked misidentifying vulnerable girls and leading to harmful policy decisions.

Company involved
Ministerio de Primera Infancia de Salta

4 source articles · read the reporting →

Chicago Tribune sues Perplexity AI for copyright infringement

Chicago Tribune Company, LLC filed a lawsuit against Perplexity AI, Inc. in the Southern District of New York on December 4, 2025. The complaint alleges copyright infringement under 17 U.S.C. § 501. The case is assigned to Judge Loretta A. Preska.

Company involved
Perplexity AI, Inc.

5 source articles · read the reporting →

WF-PS4WFM18 Mar 2023

DOGE's Flawed AI Tool Threatens Veterans Affairs Services

The Department of Government Efficiency developed an AI tool to identify unnecessary VA contracts, but it used outdated models and lacked context, leading to misclassification. At least 24 contracts were canceled, affecting cancer research and nurse care tools. The VA acknowledged the tool's role but stated all contracts undergo human review. Experts criticized the use of AI for such complex decisions.

Company involved
Department of Veterans Affairs
AI system involved
Muncher

2 source articles · read the reporting →

WF-FSUUWV6 Apr 2018

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved
Durham Constabulary
AI system involved
Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

UK government using AI for benefits and immigration decisions

The UK government is reportedly using artificial intelligence to make decisions on welfare benefits and immigration applications. The system automates decisions previously made by human caseworkers. Concerns have been raised about the fairness and transparency of such automated decisions.

10 source articles · read the reporting →

Predictim AI babysitter screening raises accuracy and bias concerns

Jessie Battaglia used Predictim, an online service that claims to use AI to assess babysitters' risk of drug abuse, bullying, or bad attitude. The service analyzes social media profiles and other online data. Experts have raised concerns about the accuracy and potential bias of the AI assessments. Predictim's CEO defended the service, saying it provides additional information for parents.

Company involved
Predictim
AI system involved
Predictim

10 source articles · read the reporting →

WF-RS0OD821 Oct 2024

Perplexity sued by Dow Jones for alleged copyright infringement

Perplexity, an AI search engine, was sued by Dow Jones, the publisher of the Wall Street Journal and New York Post, on October 21, 2024. The lawsuit alleges that Perplexity's AI reproduces copyrighted articles without permission. Perplexity denies the allegations and states it responded to outreach from News Corp before the lawsuit was filed.

Company involved
Perplexity
AI system involved
Perplexity

10 source articles · read the reporting →

WF-VHZSJ54 Jul 2025

Deloitte to refund Australian government after AI-generated report errors

Deloitte used generative AI (Azure OpenAI GPT-4o) to help produce an independent assurance review for Australia's Department of Employment and Workplace Relations. The report, published in July 2025, contained multiple errors including non-existent academic references and a fabricated court case. After the errors were flagged, Deloitte acknowledged the AI use and agreed to refund the final instalment of the A$439,000 contract. The report was corrected, but its substance and recommendations remained unchanged.

Company involved
Deloitte
AI system involved
Azure OpenAI GPT-4o

5 source articles · read the reporting →

page 1 of 2Older →