The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

57 incidents closest to “Simphony POS” · matched on meaning · public reporting

Banjo's Live Time system overstated capabilities and posed privacy risks for Utah public safety data

The Utah State Auditor reviewed the contract for Banjo's Live Time public safety application. The system was found to lack advertised AI technology and posed security risks due to direct database queries to PSAP databases. Banjo also overstated its capabilities in its response to the RFP. The auditor concluded that personally identifiable information was unlikely accessed but recommended more rigorous vetting and better security practices.

Company involved
Utah Attorney General's Office
AI system involved
Live Time

5 source articles · read the reporting →

Southern Co-op uses facial recognition with Hikvision cameras

Southern Co-op, a UK grocery chain, deployed a facial recognition system using Hikvision cameras in its stores. The system is used to identify and track customers, but the grocer did not inform customers or obtain their consent. Privacy advocates have raised concerns about compliance with GDPR and ethical risks. The grocer has stated it is committed to a high standard of privacy.

Company involved
Southern Co-op

4 source articles · read the reporting →

WF-GIG3RP26 Feb 2020

Italian regulator orders Como to stop facial recognition surveillance

The Italian Data Protection Authority (Garante) ordered the Municipality of Como to cease its use of a facial recognition system installed in Parco Tokamakhi near the main railway station. The system was intended to identify people under investigation or reported missing, and to detect suspicious behaviour. The Garante found that the municipality lacked a specific legal basis under national law for collecting and storing biometric data, and issued an injunction to conform to the law.

Company involved
Comune di Como
AI system involved
facial recognition system

9 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

WF-LBFMV812 Dec 2014

Amazon sellers lose thousands after RepricerExpress pricing glitch

A software glitch in RepricerExpress's automated repricing system caused products sold by Amazon sellers to be priced at 1p, leading to significant financial losses for the sellers. RepricerExpress apologised but did not offer compensation, while Amazon said it had reached out to affected sellers but many reported no response. Some sellers have instructed lawyers to take legal action against RepricerExpress and Amazon.

Company involved
RepricerExpress
AI system involved
RepricerExpress

10 source articles · read the reporting →

WF-WM35TW1 May 2021

Mercadona fined €2.5 million for facial recognition pilot

Mercadona, a Spanish supermarket chain, tested an early-detection system using facial recognition in 48 stores to identify people with judicial restraining orders. The system, which operated with court authorisation, notified police when such a person was detected. The Spanish data protection authority (AEPD) imposed a €2.5 million fine, which Mercadona paid, and the company has since removed the system citing legal uncertainty.

Company involved
Mercadona
AI system involved
Sistema de Detección Anticipada (Early Detection System)

10 source articles · read the reporting →

WF-U4WH351 Jun 2020

ScaleFactor reportedly failed to deliver promised automated bookkeeping software

ScaleFactor, an Austin-based startup, is reported to have failed to deliver the automated, real-time bookkeeping tools it promised customers, instead relying on human bookkeepers and a Filipino contract accounting firm. The company told Forbes in June that it was shutting down, initially blaming the pandemic, but Forbes later reported that its problems predated Covid-19. Investors reportedly came to see the company as more of a services business than a software platform, and pulled funding after a pivot to a marketplace model. No legal or regulatory action is reported.

Company involved
ScaleFactor

10 source articles · read the reporting →

WF-S574X31 Jan 2019

Spanish Supreme Court orders release of BOSCO algorithm code for social electricity bonus

The Spanish NGO Civio won a Supreme Court case forcing the government to release the source code of BOSCO, the algorithm that decides eligibility for the social electricity bonus (bono social eléctrico). Civio had demonstrated in 2019 that BOSCO contained serious errors that denied the benefit to vulnerable people who met the requirements. The government had refused to disclose the code, citing intellectual property. The Supreme Court ruled that transparency must prevail, setting a precedent for public access to automated decision-making systems.

Company involved
Ministerio para la Transición Ecológica (Gobierno de España)
AI system involved
BOSCO

10 source articles · read the reporting →

Presto Automation uses off-site human agents to double-check AI drive-thru orders

Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.

Company involved
Presto Automation Inc.

8 source articles · read the reporting →

Serco Leisure issued enforcement notices for unlawful biometric monitoring of employees

Serco Leisure and associated trusts used facial recognition and fingerprint scanning to monitor employee attendance at 38 leisure facilities. The ICO found they unlawfully processed biometric data of over 2,000 employees. Enforcement notices were issued ordering them to stop.

Company involved
Serco Leisure Operating Limited

8 source articles · read the reporting →

WF-UQ0Z2U1 Jan 2020

Domino's sued over AI phone system collecting voiceprints without consent

A class action lawsuit alleges that Domino's Pizza Inc. collected voiceprints of Illinois customers using an AI-assisted phone ordering system without their consent, violating the state's biometric privacy law. The plaintiffs, Zachery Young, Jonathan Neumann, and Odilon Garcia, claim the technology, provided by ConverseNow Technologies Inc., gathered sensitive voice data from thousands of consumers since 2020. The complaint was filed in the US District Court for the Northern District of Illinois. The case is pending.

Company involved
Domino's Pizza Inc.
AI system involved
ConverseNow AI phone ordering system

5 source articles · read the reporting →

WF-9ESV8A3 Apr 2024

Amazon Fresh drops flawed AI-powered Just Walk Out checkout system

Amazon is discontinuing its 'Just Walk Out' technology from Amazon Fresh grocery stores after the system failed to work reliably. The system, which used computer vision and AI to automatically charge customers, actually required over 1,000 human reviewers in India to manually verify transactions. Reports indicate that human review was needed for 700 out of every 1,000 sales, far exceeding Amazon's target. Amazon will replace the system with self-checkout shopping carts.

Company involved
Amazon
AI system involved
Just Walk Out

10 source articles · read the reporting →

WF-OWK2RT30 Jun 2025

Paradox security vulnerability exposed candidate data to researchers

On June 30, 2025, security researchers discovered a vulnerability in Paradox's test account that allowed access to chat interaction records. The researchers viewed five candidates' personal information including names, email addresses, phone numbers, and IP addresses. Paradox fixed the issue within hours and stated that no data was leaked publicly. The company has since implemented new security measures.

Company involved
Paradox
AI system involved
Paradox conversational AI platform

10 source articles · read the reporting →

WF-DB84QL1 Dec 2022

Jacksons Food Stores sued over facial recognition in Portland

Jacksons Food Stores is accused of violating a Portland, Oregon, city ordinance by using facial recognition technology in its stores after the ban took effect. The lawsuit, filed in December 2022, alleges the system, supplied by Blue Line Technology, wrongly identifies people as criminals and disproportionately affects women and people of colour. Customers were required to look at a camera and be scanned before entering. The retailer has not responded to the allegations.

Company involved
Jacksons Food Stores
AI system involved
First Line

10 source articles · read the reporting →

Kroger's digital price tags investigated for surge pricing concerns

U.S. Senators Elizabeth Warren and Bob Casey sent a letter to Kroger CEO Rodney McMullen raising concerns about the company's use of Electronic Shelving Labels (ESLs) for dynamic pricing. The system, called EDGE shelf and developed with Microsoft, can change prices based on time of day or weather, potentially leading to price gouging. The senators warned that this could harm consumers by increasing grocery costs and requested information from Kroger about its use of the technology.

Company involved
Kroger
AI system involved
EDGE shelf (Electronic Shelving Labels)

10 source articles · read the reporting →

WF-9A5GCW1 Feb 2024

Wendy's denies plans for surge pricing after customer backlash

Wendy's, a US burger chain, told investors it planned to test dynamic pricing on digital menu displays. The announcement drew backlash online, with accusations of price gouging. Wendy's later denied any intention to raise prices during busy periods, saying its plans had been misconstrued.

Company involved
Wendy's
AI system involved
Dynamic pricing

9 source articles · read the reporting →

Outabox hack exposes biometric data of patrons at bars, clubs and casinos

Hackers claiming to be former employees published a website allowing searches of Outabox's facial recognition database, exposing biometric and other sensitive data of patrons used for age verification at bars, clubs and casinos. The Surveillance Technology Oversight Project warns that the breach demonstrates the danger of facial recognition for age verification. S.T.O.P. has launched a campaign to ban facial recognition in public accommodations.

Company involved
Outabox

8 source articles · read the reporting →

Dynamic pricing raises Royal Opera ticket price to £415

The Royal Opera House used dynamic pricing to set ticket prices for Wagner's Siegfried. The price reached £415, among the highest for any performing arts event in British history. The algorithm increased prices based on demand, affecting ticket buyers.

Company involved
Royal Opera House

5 source articles · read the reporting →

ChatGPT 4o image generator used to create fake receipts

ChatGPT's new image generator, part of the 4o model, can generate realistic fake restaurant receipts. Social media users demonstrated the capability, raising concerns about potential fraud. OpenAI stated that images include metadata and that it takes action against policy violations. The company defended the feature as allowing creative freedom.

Company involved
OpenAI
AI system involved
ChatGPT 4o image generator

5 source articles · read the reporting →

WF-OK0FGL20 Mar 2025

Lovable security flaw exposed user data from 170 apps

Lovable, a Swedish startup, failed to fix a critical security flaw in its vibe coding service. Researchers found 170 Lovable-created web apps that exposed users' personal data, including names, emails, financial information, and API keys. Lovable acknowledged the issue and implemented a security scan, but the flaw remained unresolved.

Company involved
Lovable
AI system involved
Lovable

5 source articles · read the reporting →

WF-04DJR81 Jun 2020

Kmart's facial recognition system for refund fraud found unlawful by Privacy Commissioner

Kmart Australia deployed facial recognition technology in 28 stores from June 2020 to July 2022, capturing biometric data of every customer entering the stores and those at returns counters to detect refund fraud. The system collected sensitive information without notifying customers or obtaining their consent. The Australian Privacy Commissioner found that Kmart breached the Privacy Act, as the exemption for unlawful activity did not justify the indiscriminate and disproportionate collection of biometric data from thousands of individuals. Kmart has ceased using the system and cooperated with the investigation.

Company involved
Kmart Australia Limited

7 source articles · read the reporting →

WF-452L9H1 Jan 2024

Steak 'n Shake sued over facial recognition kiosks under BIPA

A class action lawsuit alleges that Steak 'n Shake illegally collects facial biometrics from customers using PopID-powered self-ordering kiosks without proper consent. Plaintiff Michael Massel claims the restaurant chain failed to provide notice and obtain written consent as required by Illinois' Biometric Information Privacy Act (BIPA). The suit seeks damages of up to $5,000 per violation for anyone whose biometric data was collected in Illinois in the past five years.

Company involved
Steak 'n Shake
AI system involved
PopID biometric kiosks

6 source articles · read the reporting →

WF-SU17EB1 Mar 2026

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved
Pankaj
AI system involved
AI roommate

5 source articles · read the reporting →

WF-M83U889 Sep 2026

Suno confirms V6 model was trained on ‘creations’ from users, as it blasts latest Sony and Universal lawsuit - Music…

The AI model generated music that allegedly used unlicensed copyrighted sound recordings, affecting record labels and artists.

Company involved
Suno
AI system involved
Suno V6

1 source article · read the reporting →

← Newerpage 2 of 3Older →