The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Income Insights” · matched on meaning · public reporting

$3.75M HireVue Illinois BIPA class action settlement - Top Class Actions

Collected voice and facial biometrics from job applicants during video interviews without consent

Company involved
HireVue Inc.
AI system involved
HireVue

1 source article · read the reporting →

WF-24VFAO27 Jan 2017

Illinois job applicants may get about $150 from HireVue biometric privacy settlement - The Cool Down

Job applicants were subjected to biometric data collection during video interviews without proper consent.

Company involved
HireVue
AI system involved
HireVue

1 source article · read the reporting →

She Lives in America’s Data Center Capital. Her Insane Bills Tell the Story. - Gadget Review

Data centers' electricity and water consumption raised utility bills for local residents.

Company involved
Dominion Energy

1 source article · read the reporting →

Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News

Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News

1 source article · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

WF-196C3N1 Feb 2025

Meazure Learning Agrees $1.35m California Bar Exam Class-Action Settlement - Lawyer Monthly

The exam software experienced technical failures that prevented candidates from logging in or completing the California bar exam.

Company involved
Meazure Learning
AI system involved
ProctorU

1 source article · read the reporting →

Google's Ad System Shows Gender Bias in Job Ads, Study Finds

Researchers from Carnegie Mellon University and the International Computer Science Institute used a tool called AdFisher to probe Google's ad-targeting system. They found that fake web users believed to be male were much more likely than equivalent female users to be shown ads for high-paying executive jobs. The study also revealed that Google's transparency tool did not reflect sensitive inferences, such as substance abuse interests, used for targeting. Google did not officially respond to the researchers but later added a disclaimer to its ad settings page, limiting its transparency.

Company involved
Google
AI system involved
Google ad-targeting system

10 source articles · read the reporting →

WF-5YXCSP1 Sep 2021

Uber's Secretive 'Upfront Fares' Algorithm Cuts Driver Pay in Many Cities

Uber introduced an opaque algorithm called 'Upfront Fares' to calculate driver pay in 24 U.S. cities, replacing the previous time-and-distance-based rate. Drivers report lower and unpredictable earnings, with Uber taking a larger cut of fares. The company claims the change gives drivers more control, but critics say the secrecy makes it impossible to verify fair pay. The algorithm may learn the lowest rate drivers will accept, potentially driving down wages.

Company involved
Uber
AI system involved
Upfront Fares

3 source articles · read the reporting →

WF-7U35ZD18 Mar 2024

SEC Charges Delphia and Global Predictions for False AI Claims

The SEC charged Delphia (USA) Inc. and Global Predictions Inc. for making false and misleading statements about their use of artificial intelligence. Delphia claimed from 2019 to 2023 that it used AI and machine learning to predict investments, while Global Predictions falsely claimed in 2023 to be the 'first regulated AI financial advisor'. Both firms settled the charges without admitting or denying the findings, agreeing to pay a total of $400,000 in civil penalties and to cease and desist from further violations.

Company involved
Delphia (USA) Inc. and Global Predictions Inc.

1 source article · read the reporting →

WF-BABUXF28 Feb 2026

McKinsey's Lilli AI Platform Hacked, Exposing 46 Million Chat Messages

Security researchers at CodeWall used an autonomous offensive agent to discover a SQL injection vulnerability in McKinsey's internal AI platform, Lilli. The vulnerability allowed unauthenticated access to the production database, exposing 46.5 million chat messages, 728,000 files, and 57,000 user accounts. The researchers responsibly disclosed the issue to McKinsey, who patched the endpoints within days. No data was exfiltrated or misused, and no disruption occurred.

Company involved
McKinsey & Company
AI system involved
Lilli

1 source article · read the reporting →

WF-AYFJ2A1 Jan 2018

Schufa's Black-Box Scoring Unfairly Penalises Consumers with Positive Credit Data

An investigation by SPIEGEL and BR Data reveals that Schufa's credit scoring algorithm often assigns poor risk scores to consumers with only positive credit information. One consumer, Sven Drewert, was denied a credit card limit increase despite having no negative entries. The algorithm uses limited data, and its secret formula can lead to arbitrary categorisations, affecting access to loans, phone contracts, and housing. The system's opacity and potential biases raise concerns about fairness and accountability.

Company involved
Schufa Holding AG
AI system involved
Schufa Score

2 source articles · read the reporting →

WF-CA5PVX14 Feb 2024

Meta's Advantage Plus AI ad tool overspends and underperforms for advertisers

In February 2024, Meta's automated ad platform Advantage Plus began malfunctioning, causing advertisers' costs per impression to skyrocket and blowing through daily budgets without delivering sales. Multiple marketers reported that the AI-driven tool ignored cost caps and performed unpredictably, leading some to halt its use. Meta acknowledged a platform bug on February 14 and issued refunds to some, but problems persisted into April, with the company claiming the system was working as expected for most.

Company involved
Meta
AI system involved
Advantage Plus

1 source article · read the reporting →

WF-CESBK714 Oct 2024

Portland Water Bureau AI pilot offers discount to billionaire CEO

The Portland Water Bureau used a machine learning system in a randomised control trial to identify customers for its financial assistance programme. The system selected Columbia Sportswear CEO Tim Boyle, a billionaire and one of the city's largest residential water consumers, for a 40% water bill discount. Boyle declined the discount, stating it should go to someone who needs it. The bureau is testing whether the SERVUS algorithm can accurately identify customers' ability to pay.

Company involved
Portland Water Bureau
AI system involved
Smart Discount Program

1 source article · read the reporting →

Canada Investigates Landlords' Use of AI Rent-Setting Software YieldStar

The Competition Bureau of Canada is investigating allegations that major corporate landlords, including Dream Unlimited, used AI-powered software YieldStar to coordinate rent increases. Tenant advocacy groups filed over 100 complaints, claiming the software recommended above-market rents, exacerbating housing affordability. Some landlords have since halted use of YieldStar amid public backlash, while the investigation continues.

Company involved
Dream Unlimited
AI system involved
YieldStar

7 source articles · read the reporting →

Arity collected drivers' data via apps for insurance scores

Popular smartphone apps including Life360, MyRadar and GasBuddy reportedly shared users' location and motion data with Arity, an Allstate-owned company. Arity used the data to calculate driving scores that could be sold to car insurers to set rates. Users were said not to be clearly informed that their data would be used for insurance pricing. Life360 and Arity stated that users had to opt in and that no personally identifiable driving data was shared without consent.

Company involved
Arity
AI system involved
Arity IQ network

2 source articles · read the reporting →

WF-H8TVUM1 Nov 2021

Zillow shuts down iBuying after algorithms cause $380 million loss

Zillow shut down its Zillow Offers iBuying business after its pricing algorithms, known as Zestimates, consistently overvalued homes. The company purchased thousands of homes at above-market prices and is now selling many at a loss, expecting to lose an estimated $380 million. Zillow attributed the failure to the algorithms' inability to accurately forecast home prices in a volatile market. The company will write off $569 million in home inventory and lay off 25% of its staff.

Company involved
Zillow
AI system involved
Zestimates

5 source articles · read the reporting →

WF-IGS22L1 Jan 2012

FinTech and traditional lenders discriminate against minority borrowers in mortgage pricing

A study of mortgage lending from 2012-2018 found that Latinx and African-American borrowers were charged higher interest rates than white borrowers with similar credit risk. FinTech algorithms reduced the disparity by 40% but did not eliminate it. The discrimination costs minority borrowers an estimated $765 million per year in extra interest.

10 source articles · read the reporting →

Inland Revenue warns of AI scam using commissioner's image

Scammers used AI-generated images and messaging to impersonate New Zealand's Commissioner of Inland Revenue, Peter Mersi, in social media ads inviting people to a fake crypto tax webinar. The ads aimed to trick people into giving personal information for identity theft or account access. Inland Revenue received over 3000 scam reports in three months and worked to have the ads removed, but they kept reappearing. The department warned the public about the increasing use of AI in investment scams.

2 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

SEC warns public of deep fake investment scams featuring Lance Gokongwei

The Securities and Exchange Commission (SEC) warned the public that scammers are using deep fake videos and audio of Lance Gokongwei to endorse fraudulent investment schemes. The manipulated media circulate on social media, deceiving people into investing in a platform registered in Cyprus. Victims are asked to provide credit card details and OTPs, then lose contact when attempting to withdraw funds. The SEC advises the public to verify investment offers with the agency.

2 source articles · read the reporting →

WF-AW0QVD8 Oct 2019

UberEats algorithm change causes pay cuts and financial hardship for car drivers

A survey by the Transport Workers' Union found that UberEats car drivers experienced a 50% pay cut after the company changed its delivery allocation algorithm to preference cyclists and scooter riders. Drivers reported bankruptcy, homelessness, and inability to support their families. The TWU has called for regulation of the gig economy and delivered a letter to the NSW shadow minister.

Company involved
UberEats
AI system involved
UberEats platform

10 source articles · read the reporting →

WF-KBSLAS16 Sep 2020

Shipt's new V2 algorithm reduces pay for 41% of workers, study finds

A study by MIT Media Lab and Coworker.org found that Shipt's new V2 payment algorithm reduced pay for 41% of workers by an average of 11% per shop. The algorithm, rolled out in September 2020, replaced a transparent payment system with a black-box model. Workers pooled data to analyze the impact, revealing uneven distribution of earnings.

Company involved
Shipt
AI system involved
V2

10 source articles · read the reporting →

WF-BBIPT515 Oct 2024

Google AI Overviews provide inaccurate finance information in 43% of searches

A study by The College Investor found that Google's AI Overviews provided misleading or inaccurate information in 43% of 100 personal finance-related searches. The AI-generated answers included outdated tax rules and incorrect student loan repayment plan details. One user believed she could convert her 529 plan to a Roth IRA in California, which is not allowed. Google has not responded to requests for comment.

Company involved
Google
AI system involved
AI Overviews

3 source articles · read the reporting →

WF-XGIXWV31 Jan 2020

DWP's Universal Credit algorithm causes underpayment and hardship for claimants

The Department for Work and Pensions (DWP) uses an automated means-testing algorithm in its Universal Credit system that miscalculates earnings due to a design flaw, leading to underpayments and fluctuating benefit amounts. Claimants such as Janet R. received payments hundreds of pounds short, forcing them into debt and foodbank use. A Court of Appeal ruling in June 2020 ordered the DWP to fix the flaw, but the department had not yet fully implemented the remedy at the time of writing.

Company involved
Department for Work and Pensions
AI system involved
Universal Credit

10 source articles · read the reporting →

page 1 of 2Older →