The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Demand Plus” · matched on meaning · public reporting

WF-1ABAJU7 May 2026EN

Maryland residents to pay $1.6 billion more in power bills due to out-of-state data centers: complaint

Maryland's Office of People's Counsel filed a complaint with the Federal Energy Regulatory Commission against grid operator PJM, saying its cost allocation would make Maryland households pay about $1.6 billion over a decade for transmission built to serve data centres in other states, from which they do not benefit.

Company involved
PJM Interconnection
AI system involved
Transmission cost allocation for data centres

1 source article · read the reporting →

Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News

Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News

1 source article · read the reporting →

WF-0V6MSIArabic

Google AI Search Shows Product Prices 21.6% Higher

بحث غوغل بالذكاء الاصطناعي يعرض أسعارًا أعلى بـ 21.6% للمنتجات - وكالة عمون الاخبارية

A study found that Google's AI Mode shows the same products at prices 21.6% higher on average compared to traditional search. The primary seller for the same product differed nearly 50% of the time, suggesting AI Mode prioritizes different sellers and is less focused on low prices. Google stated that all shopping results, including AI Mode, use the same Shopping Graph data source.

Company involved
Google
AI system involved
AI Mode

1 source article · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

WF-378VKW1 Sep 2016

Amazon's Algorithm Favours Its Own Products Over Cheaper Alternatives

ProPublica found that Amazon's buy box algorithm often selects Amazon's own products or those of sellers who pay for its services, even when cheaper options exist. This results in customers paying higher prices, with an average difference of $7.88 per product. Sellers who do not pay for Amazon's Fulfilled by Amazon programme are disadvantaged and may lose sales. Amazon states that the algorithm considers factors beyond price, such as shipping speed and customer service.

3 source articles · read the reporting →

WF-5YXCSP1 Sep 2021

Uber's Secretive 'Upfront Fares' Algorithm Cuts Driver Pay in Many Cities

Uber introduced an opaque algorithm called 'Upfront Fares' to calculate driver pay in 24 U.S. cities, replacing the previous time-and-distance-based rate. Drivers report lower and unpredictable earnings, with Uber taking a larger cut of fares. The company claims the change gives drivers more control, but critics say the secrecy makes it impossible to verify fair pay. The algorithm may learn the lowest rate drivers will accept, potentially driving down wages.

Company involved
Uber
AI system involved
Upfront Fares

3 source articles · read the reporting →

WF-Z7PLQV18 Apr 2011

Algorithmic Pricing Glitch Causes $24 Million Book Listing on Amazon

Two booksellers on Amazon, profnath and bordeebook, used algorithmic pricing to automatically adjust their prices relative to each other. Due to a lack of upper price limits, their algorithms entered a feedback loop, driving the price of a used copy of 'The Making of a Fly' to over $23 million. The error was discovered by a researcher and the price was later manually corrected by one of the sellers. No purchase was made at the inflated price.

Company involved
profnath and bordeebook
AI system involved
Amazon algorithmic pricing

2 source articles · read the reporting →

WF-CA5PVX14 Feb 2024

Meta's Advantage Plus AI ad tool overspends and underperforms for advertisers

In February 2024, Meta's automated ad platform Advantage Plus began malfunctioning, causing advertisers' costs per impression to skyrocket and blowing through daily budgets without delivering sales. Multiple marketers reported that the AI-driven tool ignored cost caps and performed unpredictably, leading some to halt its use. Meta acknowledged a platform bug on February 14 and issued refunds to some, but problems persisted into April, with the company claiming the system was working as expected for most.

Company involved
Meta
AI system involved
Advantage Plus

1 source article · read the reporting →

WF-CESBK714 Oct 2024

Portland Water Bureau AI pilot offers discount to billionaire CEO

The Portland Water Bureau used a machine learning system in a randomised control trial to identify customers for its financial assistance programme. The system selected Columbia Sportswear CEO Tim Boyle, a billionaire and one of the city's largest residential water consumers, for a 40% water bill discount. Boyle declined the discount, stating it should go to someone who needs it. The bureau is testing whether the SERVUS algorithm can accurately identify customers' ability to pay.

Company involved
Portland Water Bureau
AI system involved
Smart Discount Program

1 source article · read the reporting →

Canada Investigates Landlords' Use of AI Rent-Setting Software YieldStar

The Competition Bureau of Canada is investigating allegations that major corporate landlords, including Dream Unlimited, used AI-powered software YieldStar to coordinate rent increases. Tenant advocacy groups filed over 100 complaints, claiming the software recommended above-market rents, exacerbating housing affordability. Some landlords have since halted use of YieldStar amid public backlash, while the investigation continues.

Company involved
Dream Unlimited
AI system involved
YieldStar

7 source articles · read the reporting →

WF-ZTR26N1 Nov 2023

DC attorney general sues 14 landlords over RealPage rent collusion

The Attorney General of Washington DC filed a lawsuit against 14 large landlords, alleging they used RealPage's YieldStar software to form “a District-wide housing cartel” that artificially inflated rents. The complaint claims RealPage's pricing algorithm used data supplied by the landlords and pressurised them to follow its rate recommendations, with one firm's internal presentation stating at least 95% compliance was expected. This alleged scheme caused residents to pay millions of dollars above fair market prices during a housing affordability crisis.

Company involved
Greystar Management Services
AI system involved
YieldStar

10 source articles · read the reporting →

WF-78BIQP3 Jun 2017

Uber's pricing algorithm surged prices during London Bridge attack

On June 3, 2017, during a terrorist attack on London Bridge, Uber's dynamic pricing algorithm increased ride prices by over 200% for 43 minutes. Customers attempting to flee the area faced surge pricing. The algorithm automatically adjusted prices based on supply and demand without accounting for the emergency.

Company involved
Uber

7 source articles · read the reporting →

RealPage's YieldStar algorithm pushes rents higher for tenants

RealPage's YieldStar algorithm uses private competitor data to recommend rent increases for apartment units. Landlords adopt up to 90% of the suggestions, leading to higher rents for tenants. Critics allege the software may facilitate indirect price-fixing in violation of antitrust law. The company denies wrongdoing and says the software helps eliminate collusion.

Company involved
RealPage
AI system involved
YieldStar

10 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

WF-KBSLAS16 Sep 2020

Shipt's new V2 algorithm reduces pay for 41% of workers, study finds

A study by MIT Media Lab and Coworker.org found that Shipt's new V2 payment algorithm reduced pay for 41% of workers by an average of 11% per shop. The algorithm, rolled out in September 2020, replaced a transparent payment system with a black-box model. Workers pooled data to analyze the impact, revealing uneven distribution of earnings.

Company involved
Shipt
AI system involved
V2

10 source articles · read the reporting →

WF-XGIXWV31 Jan 2020

DWP's Universal Credit algorithm causes underpayment and hardship for claimants

The Department for Work and Pensions (DWP) uses an automated means-testing algorithm in its Universal Credit system that miscalculates earnings due to a design flaw, leading to underpayments and fluctuating benefit amounts. Claimants such as Janet R. received payments hundreds of pounds short, forcing them into debt and foodbank use. A Court of Appeal ruling in June 2020 ordered the DWP to fix the flaw, but the department had not yet fully implemented the remedy at the time of writing.

Company involved
Department for Work and Pensions
AI system involved
Universal Credit

10 source articles · read the reporting →

WF-GP9JON1 Jan 2013

Allstate's proposed retention model charged big spenders more in Maryland

Allstate proposed an auto insurance rate adjustment plan in Maryland using a retention model algorithm that varied premium changes based on existing premiums. The algorithm would have increased rates up to 20% for customers already paying the highest premiums while capping increases at 5% for others, and would have denied meaningful discounts to thousands owed reductions. The Maryland Insurance Administration rejected the plan as discriminatory, but Allstate claims it was withdrawn and has continued proposing similar models elsewhere. The proposal never took effect in Maryland.

Company involved
Allstate Corporation
AI system involved
retention model

9 source articles · read the reporting →

WF-FH1O731 Jan 2017

DoorDash changes tipping policy after backlash over worker tips

DoorDash, a food delivery company, changed its tipping policy after backlash. The company had been using customer tips to offset its base pay to delivery workers, meaning workers did not receive the full tips. After public outcry and promises from CEO Tony Xu, DoorDash announced a new model where workers will keep all tips, effective next month.

Company involved
DoorDash

10 source articles · read the reporting →

WF-8XBASW1 Jan 2016

Uber algorithm reinforced gender pay gap in compensation offers to new hires

Uber used an algorithm to determine compensation offers for new hires, allegedly paying women less than men for similar roles. The algorithm was designed to protect existing shareholders and save money, but it reinforced existing gender pay gaps. The system is now being altered, according to The Information.

Company involved
Uber

7 source articles · read the reporting →

Amazon offers commitments to address EU antitrust concerns over seller data and Buy Box bias

The European Commission announced that Amazon has offered commitments to address competition concerns regarding its use of non-public data from independent sellers and alleged bias in its Buy Box and Prime programmes. The Commission preliminarily found that Amazon's automated systems may distort competition by favouring its own retail business and sellers using its logistics. Amazon commits to refrain from using seller data for retail decisions and to ensure equal treatment in Buy Box and Prime. The commitments are subject to a market test before becoming legally binding.

Company involved
Amazon
AI system involved
Buy Box and Prime algorithms

10 source articles · read the reporting →

WF-YQ3F4O1 Nov 2015

Airbnb smart-pricing algorithm increased racial revenue gap, study finds

A study by Carnegie Mellon University found that Airbnb's smart-pricing algorithm increased the revenue gap between White and Black hosts, even though it narrowed the gap among hosts who adopted it. The algorithm, which sets daily prices automatically, was adopted by fewer Black hosts, so its suggested prices were closer to the optimum for White hosts. The researchers said the tool could reduce racial disparities only if more Black hosts adopted it.

Company involved
Airbnb
AI system involved
Airbnb smart-pricing algorithm

10 source articles · read the reporting →

WF-LBFMV812 Dec 2014

Amazon sellers lose thousands after RepricerExpress pricing glitch

A software glitch in RepricerExpress's automated repricing system caused products sold by Amazon sellers to be priced at 1p, leading to significant financial losses for the sellers. RepricerExpress apologised but did not offer compensation, while Amazon said it had reached out to affected sellers but many reported no response. Some sellers have instructed lawyers to take legal action against RepricerExpress and Amazon.

Company involved
RepricerExpress
AI system involved
RepricerExpress

10 source articles · read the reporting →

WF-V4BUUG21 Jun 2022

Bruce Springsteen addresses Ticketmaster dynamic pricing outrage

Bruce Springsteen addressed fan outrage over Ticketmaster's dynamic pricing for his 2023 tour, which led to ticket prices skyrocketing up to $5,000. Springsteen said he told his team to do what other artists do and that most tickets were affordable. He offered refunds to fans who complained.

Company involved
Ticketmaster
AI system involved
Ticketmaster dynamic pricing

9 source articles · read the reporting →

WF-J4NN6L14 Oct 2021

Amazon's search algorithm favors its own brands over competitors

The Markup investigated Amazon's product search results and found that the company's algorithm prioritizes its own house brands and exclusive products over competitors, even when competitors have higher ratings and more reviews. A national survey commissioned by The Markup found that 90% of respondents were unaware that Amazon's highest-selling house brands were owned by the company. Amazon denied favoring its own brands in search results.

Company involved
Amazon
AI system involved
Amazon product search ranking algorithm

10 source articles · read the reporting →

page 1 of 2Older →