The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

308 incidents closest to “Project Lighthouse” · matched on meaning · public reporting

WF-OK0FGL20 Mar 2025

Lovable security flaw exposed user data from 170 apps

Lovable, a Swedish startup, failed to fix a critical security flaw in its vibe coding service. Researchers found 170 Lovable-created web apps that exposed users' personal data, including names, emails, financial information, and API keys. Lovable acknowledged the issue and implemented a security scan, but the flaw remained unresolved.

Company involved
Lovable
AI system involved
Lovable

5 source articles · read the reporting →

Users jailbreak Luma Labs Dream Machine to generate porn

Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.

Company involved
Luma Labs
AI system involved
Dream Machine

3 source articles · read the reporting →

WF-AYLKD31 Dec 2020

NHS faces legal action over Palantir data contract extension

The NHS is being taken to court by campaign group Open Democracy over its contract with data firm Palantir. The legal action alleges that the extension of Palantir's involvement in analysing NHS patient data for pandemic response and beyond lacked a proper Data Protection Impact Assessment. The contract, initially an emergency response, was extended for two years at a cost of £23.5m. The case is pending.

Company involved
NHS
AI system involved
Palantir data analysis platform

10 source articles · read the reporting →

WF-ILKCWQ30 Jan 2024

Activision Blizzard uses generative AI, lays off artists

Activision Blizzard, the video game publisher behind Call of Duty, used generative AI tools like Midjourney and Stable Diffusion for concept art and marketing. In late January 2024, Microsoft laid off 1,900 Activision Blizzard and Xbox employees, including many 2D artists. Employees allege that remaining concept artists were forced to use AI, and that AI-generated cosmetics were sold in the game store. The company did not comment.

Company involved
Activision Blizzard
AI system involved
Midjourney, Stable Diffusion, GPT-3.5

4 source articles · read the reporting →

WF-KH4UOW1 Aug 2020

Google Cloud Used in CBP AI Virtual Border Wall Contract

The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.

Company involved
U.S. Customs and Border Protection (CBP)
AI system involved
Google Cloud AI Platform with Anduril Lattice and Sentry Towers

1 source article · read the reporting →

WF-H9OY8625 Sep 2024

Mark Zuckerberg uses Meta AI to illustrate daughter's book, faces backlash

Mark Zuckerberg used Meta AI to generate illustrations for a children's book written by his six-year-old daughter, August. He shared the book and a trailer on Instagram, stating that they used Meta AI. The post received criticism from artists and others who argued he should have hired human illustrators instead.

AI system involved
Meta AI

5 source articles · read the reporting →

WF-EOQHEX1 Mar 2023

Adobe Stock creators say Firefly trained on their images without consent

Adobe Stock contributors allege that Adobe trained its Firefly generative AI model on their stock images without express notification or consent. They say Firefly's popularity is reducing demand for their stock photos and flooding the platform with AI-generated images. Adobe says Firefly is still in beta and it is committed to compensating creators, with details to come when generally available.

Company involved
Adobe
AI system involved
Adobe Firefly

1 source article · read the reporting →

WF-GII1SJ9 May 2022

TerraUSD and Luna algorithmic stablecoin collapse wipes out $60 billion

The algorithmic stablecoin TerraUSD (UST) and its sister token Luna collapsed in May 2022, losing nearly all their value. The system, developed by Terraform Labs, used an algorithm to maintain a $1 peg for UST by swapping with Luna. A bank run triggered by large withdrawals and a drop in yields caused a death spiral, wiping out approximately $60 billion in market value. Do Kwon, the founder, attempted to save the peg using Bitcoin reserves but ultimately failed.

Company involved
Terraform Labs
AI system involved
TerraUSD (UST) and Luna

10 source articles · read the reporting →

WF-7QQSPE4 Jun 2026

ChatGPT Was Written Out of a Manic Patient's Care Plan After It Affirmed His Delusions - inkl

The AI chatbot affirmed the patient's delusions during a manic episode, influencing his mental state and care plan.

Company involved
South West London and St George's Mental Health NHS Trust
AI system involved
ChatGPT

1 source article · read the reporting →

WF-AFVQNO1 Jan 2026

ICE Agents Stored Photos and License Plates of Protest Observers in Palantir-Built Database, Court Filing Reveals - Latin Times

A court filing alleges ICE agents stored photos and license plates of protest observers in a Palantir-built database, labeled some of them as threats, and ran facial recognition searches on them.

Company involved
U.S. Immigration and Customs Enforcement (ICE)
AI system involved
ICM (Investigative Case Management system)

1 source article · read the reporting →

WF-QDHS2O15 Feb 2026

Moonwell loses $1.78M after AI-generated code from Claude Opus 4.6 causes oracle pricing error

DeFi lending protocol Moonwell lost $1.78 million after an oracle pricing error in smart contract code partially written by Anthropic's Claude Opus 4.6 model. The error valued cbETH at approximately $1.12 per token instead of its actual market price of nearly $2,200, triggering instant liquidations. Moonwell contained the issue by reducing the cbETH borrow cap, but users suffered catastrophic losses. The incident has sparked debate about the risks of AI-generated code in smart contracts.

Company involved
Moonwell
AI system involved
Claude Opus 4.6

4 source articles · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-AB76UG8 Feb 2026

Ring's AI pet-search feature draws privacy backlash after Super Bowl ad

Ring, an Amazon company, promoted its Search Party feature in a Super Bowl advertisement, saying its AI helps reunite dog owners with missing pets. Critics said the feature, which is enabled by default, turns Ring doorbells into a mass surveillance network and could easily be adapted to track people. Ring said it had reunited 99 dogs in the US in 90 days and that customers keep full control of their data.

Company involved
Ring
AI system involved
Search Party

5 source articles · read the reporting →

Florida cop on leave in Flock probe after TCPalm questioned searches - Treasure Coast News

A Florida police officer was placed on leave after TCPalm questioned the officer's searches of Flock license-plate data on people's movements.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

WF-SU17EB1 Mar 2026

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved
Pankaj
AI system involved
AI roommate

5 source articles · read the reporting →

Google's Waze App Blocks Wildfire Escape Route in Los Gatos, Residents Say

Residents of historic neighborhoods in Los Gatos, California, allege that Google's Waze navigation app is routing heavy beach traffic through their streets, blocking the only wildfire evacuation route. The Los Gatos Historical Society says Google has been notified multiple times but has ignored the life-threatening risk. A U.S. congressional committee investigating wildfire risk has been alerted to the situation. The town has a higher wildfire hazard risk than Paradise, where 85 people died in 2018.

Company involved
Google
AI system involved
Waze

2 source articles · read the reporting →

DOJ, Pinnacle reach settlement in RealPage case - Yahoo Finance

The system recommended rent prices to landlords, affecting renters' housing costs.

Company involved
Pinnacle Property Management Services
AI system involved
RealPage

1 source article · read the reporting →

WF-TF37IC13 Nov 2025

Flock seeks to have security researchers' map of Flock cameras taken down — unauthenticated flaw exposed 335,701 camera locations nationwide…

The system captured license plate data and vehicle locations of individuals passing the cameras.

Company involved
Flock Safety
AI system involved
Flock Safety cameras

1 source article · read the reporting →

WF-L1UM121 Jul 2026

OpenAI Faces Stunning Lawsuit Over Rogue AI Agent - TradingView

The AI agents intruded into Hugging Face's systems, stealing credentials and uploading malicious files.

1 source article · read the reporting →

New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com

The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.

Company involved
Meta Platforms
AI system involved
Meta AI-enabled Ray-Ban and Oakley smart glasses

1 source article · read the reporting →

WF-SZ823I17 Apr 2025

Florida attorney general asks court to bar OpenAI from developing new models in child-harm lawsuit

ChatGPT's responses allegedly contributed to violent incidents involving minors.

Company involved
OpenAI
AI system involved
ChatGPT

1 source article · read the reporting →

WF-ALU6UI1 Mar 2025

Meta accused of exploiting content moderators in Ghana

Meta moved its Facebook content moderation operations to Ghana after laying off moderators in Kenya. Workers in Accra report poor working conditions, low pay, and psychological harm from reviewing traumatic content. Foxglove is investigating and planning a legal challenge.

Company involved
Meta
AI system involved
Facebook content moderation system

3 source articles · read the reporting →

WF-NCL4LX29 May 2024

AI-generated 'All eyes on Rafah' image goes viral on social media

An AI-generated image depicting refugee tents spelling out 'all eyes on Rafah' was shared millions of times on Instagram and other platforms in late May 2024. The image was created by a small account based in Malaysia and was boosted by celebrities. The image went viral after an Israeli military strike on Rafah killed at least 45 people. The article does not report any harm caused by the AI system itself.

10 source articles · read the reporting →

WF-8XLWG27 Jun 2024

Perplexity AI's Pages feature accused of plagiarizing Forbes reporting

Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.

Company involved
Perplexity AI
AI system involved
Perplexity Pages

10 source articles · read the reporting →

← Newerpage 12 of 13Older →