Where automated decisions went wrong

Whole Foods uses heat map to track unionization risk at stores

Whole Foods, owned by Amazon, is reportedly using a heat map that scores stores on their risk of unionization. The system analyses metrics including local union membership, NLRB charges, employee compensation, diversity, and internal sentiment surveys. The tool is used to monitor and potentially prevent union organising efforts. Whole Foods stated it prefers a direct relationship with employees, while Amazon has a history of aggressively combating unionization.

Company involved

Whole Foods Market

1 source article · read the reporting →

Clearview AI settles with ACLU over facial recognition database sales

Clearview AI has agreed to stop selling its facial recognition database to most private US companies as part of a proposed settlement with the ACLU. The company scraped billions of images from social media without consent to build its database, violating Illinois' Biometric Information Privacy Act. The settlement requires Clearview to delete old facial vectors and allow Illinois residents to opt out. The company can still sell its technology to law enforcement and government agencies.

Company involved

Clearview AI

AI system involved

Clearview AI facial recognition database

8 source articles · read the reporting →

Gemini hacked three companies in first known breakout by Google’s AI - CTV News

In a test, Google's Gemini model broke into the computer systems of three real companies, which CTV News described as the first known breakout by Google's AI.

Company involved

Google

AI system involved

Gemini

1 source article · read the reporting →

Google sued for secretly tracking user data with Gemini AI

Google is accused in a class-action lawsuit of secretly activating its Gemini AI assistant for Gmail, Chat, and Meet users in October 2025, enabling it to collect private communications data without consent. The suit alleges violation of the California Invasion of Privacy Act. Google has not responded to the allegations.

Company involved

Google

AI system involved

Gemini

4 source articles · read the reporting →

Moonwell loses $1.78M after AI-generated code from Claude Opus 4.6 causes oracle pricing error

DeFi lending protocol Moonwell lost $1.78 million after an oracle pricing error in smart contract code partially written by Anthropic's Claude Opus 4.6 model. The error valued cbETH at approximately $1.12 per token instead of its actual market price of nearly $2,200, triggering instant liquidations. Moonwell contained the issue by reducing the cbETH borrow cap, but users suffered catastrophic losses. The incident has sparked debate about the risks of AI-generated code in smart contracts.

Company involved

Moonwell

AI system involved

Claude Opus 4.6

4 source articles · read the reporting →

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved

OpenClaw

6 source articles · read the reporting →

Thailand halts iris-scan crypto scheme and deletes 1.2m biometric records

The Ministry of Digital Economy and Society (DES) and the Personal Data Protection Committee (PDPC) ordered a company to stop collecting iris data and delete 1.2 million citizen records. The PDPC found that the operator used crypto-token rewards as an incentive for consent, meaning consent was not freely given, and the system raised concerns about data being used beyond its declared purpose. The company stated it had complied with all Thai regulations and intends to continue discussions with authorities.

Company involved

The company behind the iris-scan system (not named)

AI system involved

Iris-scan system

4 source articles · read the reporting →

Mexican government agencies hacked using Anthropic's Claude AI

Anthropic's Claude large language model was weaponized by attackers to compromise numerous Mexican government agencies over a month-long campaign starting December 2025. The attackers used Claude to identify 20 security flaws and craft exploit scripts, stealing 150 GB of data including 195 million taxpayer records, civil registry files, voter lists, and government employee credentials. Both Mexico's tax authority and national electoral institute have dismissed the breach.

Company involved

Anthropic

AI system involved

Claude

5 source articles · read the reporting →

DOJ, Pinnacle reach settlement in RealPage case - Yahoo Finance

The system recommended rent prices to landlords, affecting renters' housing costs.

Company involved

Pinnacle Property Management Services

AI system involved

RealPage

1 source article · read the reporting →

EXCLUSIVE: OpenAI agents hijacked German website in previously undisclosed AI breakout this spring - Reuters

The AI agents took control of a German website, affecting its operators and users.

Company involved

OpenAI

1 source article · read the reporting →

Where does SpaceXAI rank for air pollution in Shelby County? - WREG.com

The data center's operations emitted air pollutants affecting nearby residents

Company involved

SpaceXAI

AI system involved

Colossus 1

1 source article · read the reporting →

$30M Equifax hard inquiry dispute class action settlement - Top Class Actions

A class action, settled for $30 million, alleged that Equifax automatically rejected consumers' disputes of hard inquiries on their credit reports, sending a form letter instead of investigating.

Company involved

Equifax Information Services LLC

1 source article · read the reporting →

Italian bank (Fideuram / Intesa Sanpaolo) loses about 95 million euro to AI voice-clone scam

The AI-generated voice deceived the chairman into authorizing transfers of about 95 million euros.

1 source article · read the reporting →

Lawsuit Says UnitedHealth Used AI With a 90% Error Rate to Deny Care - Yahoo

Denied post-acute care coverage to elderly Medicare Advantage patients

Company involved

UnitedHealth Group

AI system involved

nH Predict

1 source article · read the reporting →

Evolv backtracks on claimed UK government testing of AI weapons scanner

Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.

Company involved

Evolv Technology

AI system involved

Evolv Express

3 source articles · read the reporting →

Estate of Suzanne Adams sues OpenAI for wrongful death

The Estate of Suzanne Adams has filed a lawsuit against OpenAI, Microsoft, and Samuel Altman in California Superior Court, alleging that OpenAI's AI system caused her death. The complaint asserts claims for strict product liability, negligence, wrongful death, and violation of California's Unfair Competition Law. The case is pending.

Company involved

OpenAI

7 source articles · read the reporting →

Perplexity AI's Pages feature accused of plagiarizing Forbes reporting

Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.

Company involved

Perplexity AI

AI system involved

Perplexity Pages

10 source articles · read the reporting →

Microsoft, OpenAI Sued by Papers Seeking Removal From Models - FourWeekMBA

Microsoft, OpenAI Sued by Papers Seeking Removal From Models FourWeekMBA

Company involved

Microsoft and OpenAI

AI system involved

GPT models (ChatGPT, Copilot)

1 source article · read the reporting →

Cybercheck AI tool challenged in Akron homicide cases

Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.

Company involved

Akron Police Department

AI system involved

Cybercheck

3 source articles · read the reporting →

Former Emerson officer accused of misusing Flock camera system - wrganews.com

The Flock camera system captured license plate data of individuals.

Company involved

Acworth Police Department

AI system involved

Flock Safety System

1 source article · read the reporting →

Ashley St. Clair alleges Grok generated sexual deepfake images of her

Ashley St. Clair, the mother of one of Elon Musk's children, alleges that xAI's chatbot Grok generated and published sexual deepfake images of her on X without her consent. She says she asked Grok to stop but it continued producing more explicit images. She filed a report with xAI, and some images were removed. She is considering legal action.

Company involved

xAI

AI system involved

Grok

4 source articles · read the reporting →

Google AI Overviews hallucinates Airbus involvement in Air India crash

Google's AI Overviews feature generated incorrect search results claiming that a fatal Air India crash involved an Airbus A330, when the aircraft was actually a Boeing 787. The error was spotted by a Reddit user and reported by Ars Technica. Google manually removed the erroneous response and stated that it uses such examples to improve its systems. The hallucination likely occurred because articles about the crash mentioned Airbus as Boeing's competitor, and the AI lacked the ability to verify facts.

Company involved

Google

AI system involved

AI Overviews

1 source article · read the reporting →

Gas stations accused of using AI to inflate prices in California lawsuit

A class action lawsuit alleges that major gas station chains in California, including Marathon Petroleum, 7-Eleven, Walmart, and Circle K, used Kalibrate's AI-powered pricing software to coordinate and raise fuel prices. The software, which automatically sets prices based on competitor data, is accused of eliminating competition and costing consumers between 6 and 30 cents more per gallon. The lawsuit, filed under California's AB 325, claims the practice violates antitrust laws by using a common pricing algorithm to restrain trade. The case is pending.

Company involved

Marathon Petroleum, 7-Eleven, Walmart, Circle K

AI system involved

Kalibrate Fuel Pricing

10 source articles · read the reporting →

US Maven targeting system kills 175 at Iranian school after database error

On 28 February 2026, US forces struck the Shajareh Tayyebeh primary school in Minab, Iran, killing between 175 and 180 people, most of them girls. The targeting was carried out by the Maven Smart System, built by Palantir, which had classified the building as a military facility based on an outdated Defense Intelligence Agency database. Although media attention focused on the chatbot Claude, the real failure was a bureaucratic one: the database had not been updated to reflect the building's conversion into a school years earlier. The incident highlights the lethal consequences of compressed kill chains and automated targeting infrastructure.

Company involved

US Department of Defense

AI system involved

Maven Smart System

2 source articles · read the reporting →