The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

308 incidents closest to “Butterfly iQ3” · matched on meaning · public reporting

WF-ZW37ZY31 Oct 2023

Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians

In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.

Company involved
Israel Defense Forces

3 source articles · read the reporting →

WF-CDY4BR1 Jul 2024

Perplexity AI Misdiagnosis Leads to Man's Death After He Avoids Cancer Treatment

Benjamin Riley's father, a former neuroscientist, used Perplexity AI to self-diagnose his chronic lymphocytic leukemia and was incorrectly told he had Richter's Transformation, leading him to refuse his oncologist's recommended Ven-Obi treatment for a year. Despite his son's efforts to correct the misinformation by contacting the study authors, the father's condition worsened, and he eventually started treatment but died weeks later. The incident highlights the dangers of relying on AI for medical advice.

Company involved
Perplexity AI
AI system involved
Perplexity AI

1 source article · read the reporting →

WF-GY0FZ528 Aug 2025

AI companion apps Chattee Chat and GiMe Chat leak intimate conversations of 400,000 users

Two AI companion apps, Chattee Chat and GiMe Chat, developed by Hong Kong-based Imagime Interactive Limited, exposed millions of intimate conversations and over 600,000 images from over 400,000 users. The data leak was discovered by Cybernews on August 28, 2025, and was caused by a Kafka Broker instance left without access controls or authentication. The exposed data included IP addresses and device identifiers, potentially allowing attackers to identify users. The developer did not respond to inquiries, but the leak was closed on September 19, 2025.

Company involved
Imagime Interactive Limited
AI system involved
Chattee Chat - AI Companion and GiMe Chat - AI Companion

4 source articles · read the reporting →

WF-SMARMB1 Jan 2023

AI image generation triggers psychosis in startup employee

Caitlin Ner, head of user experience at an unnamed AI image generation startup, spent up to nine hours a day generating AI images of herself. Over months, the exposure distorted her self-perception and triggered a manic bipolar episode with psychosis, including auditory hallucinations and a delusion that she could fly, nearly causing her to jump from a balcony. She left the startup, sought therapy, and recovered. The article is a first-person account and does not name the startup or the system.

2 source articles · read the reporting →

WF-DDDGZY13 Oct 2025

Xiaomi SU7 fatal crash in Chengdu raises EV safety concerns

A Xiaomi SU7 electric vehicle crashed in Chengdu, China, and caught fire. Bystanders were unable to open the electronic door handles to rescue an occupant, and a 31-year-old male driver died. The incident follows an earlier fatal SU7 crash that raised questions about the vehicle's smart driving features, and has intensified scrutiny on electronic door handle safety.

Company involved
Xiaomi
AI system involved
SU7

3 source articles · read the reporting →

Imperial College AI stethoscope falsely identified heart failure in two-thirds of flagged patients

Researchers at Imperial College London and Imperial College Healthcare NHS Trust have developed an AI-powered stethoscope that analyses heart rhythms and performs an ECG, sending results to a doctor's smartphone. A study of more than 12,000 patients across the UK found that two-thirds of patients flagged as having heart failure did not actually have the condition. The researchers acknowledged that the false positives could cause unnecessary anxiety, and many GP surgeries stopped using or barely used the device after 12 months. The team plans to deploy the stethoscope more widely.

Company involved
Imperial College London and Imperial College Healthcare NHS Trust

6 source articles · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-SU17EB1 Mar 2026

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved
Pankaj
AI system involved
AI roommate

5 source articles · read the reporting →

WF-SH1YQXArabic

Waymo Self-Driving Taxis Proactively Report to Police After Discovering Passenger Hiding a Gun

قامت سيارات الأجرة ذاتية القيادة من شركة Waymo بإبلاغ الشرطة بشكل استباقي بعد اكتشافها أن أحد الركاب كان يخفي مسدساً.…

A Waymo self-driving taxi in San Francisco detected two teenage passengers carrying an unidentified AR-15 rifle loaded with ammunition. The vehicle automatically stopped and alerted police, leading to the arrest of the two teenagers. Waymo stated that its system can identify violations of its terms of service, including carrying weapons, and will proactively notify police.

Company involved
Waymo

1 source article · read the reporting →

Hackers Extract Encryption Keys from Flock Surveillance Cameras, Revealing Person Detection Alongside Vehicle Tracking - finance.biggo.com

The system detected and recorded images of vehicles and people, affecting individuals in public spaces.

Company involved
Flock Safety
AI system involved
Flock Safety ALPR cameras

1 source article · read the reporting →

WF-4XJW4F30 Sep 2026Portuguese

Investigation probes autopilot failure after fatal Tesla accident in the United States

Investigação apura falha no piloto automático após acidente fatal com Tesla nos Estados Unidos - dfmobilidade.com.br

A fatal crash involving a Tesla Model 3 occurred at an intersection in Buena Vista Township, New Jersey. Authorities are investigating a possible failure of the Autopilot system and whether it was active at the time, adding to scrutiny of Tesla's driver-assistance technology.

Company involved
Tesla
AI system involved
Autopilot

1 source article · read the reporting →

Sibuxiang Genuine + Genuine Sibuxiang: Tesla Autopilot in Another Accident, Owner Says System Failed to Recognize Construction Barriers, Causing Rear-End…

四不像正版+正版四不像特斯拉自动驾驶再出事故,车主称系统未识别施工路障致追尾 - Pchome电脑之家

A Tesla owner reported that the vehicle's Autopilot system did not detect construction barriers, leading to a rear-end collision. The incident was reported by Pchome.

Company involved
Tesla
AI system involved
Autopilot

1 source article · read the reporting →

An abortion case has become flashpoint in Flock cameras controversy; Texas sheriff’s office used it to tr - The Times…

A Texas sheriff's office used Flock license-plate cameras to track a woman's vehicle in a case involving a self-administered abortion, making the case a flashpoint in the debate over the cameras.

Company involved
Flock
AI system involved
Flock, Axon Draft One

1 source article · read the reporting →

WF-3XBQHG1 Sep 2023

UK schools install toilet sensors that listen for keywords to monitor pupils

Several UK schools, including St Joseph's College in Stoke-on-Trent, have installed Halo Smart Sensors in toilets that use machine learning to detect keywords such as 'help me' and 'stop it'. The sensors trigger alerts to staff when keywords are detected, aiming to crack down on vaping and bullying. Privacy advocates argue the sensors violate children's privacy and may be unlawful. The schools have not sought parental consent for the monitoring.

Company involved
St Joseph's College
AI system involved
Halo Smart Sensors

4 source articles · read the reporting →

WF-HE06HX10 May 2024

NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles

Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users

Company involved
Zoox
AI system involved
Zoox vehicle

1 source article · read the reporting →

WF-V0IBRA20 Feb 2024

Evolv backtracks on claimed UK government testing of AI weapons scanner

Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.

Company involved
Evolv Technology
AI system involved
Evolv Express

3 source articles · read the reporting →

WF-NCL4LX29 May 2024

AI-generated 'All eyes on Rafah' image goes viral on social media

An AI-generated image depicting refugee tents spelling out 'all eyes on Rafah' was shared millions of times on Instagram and other platforms in late May 2024. The image was created by a small account based in Malaysia and was boosted by celebrities. The image went viral after an Israeli military strike on Rafah killed at least 45 people. The article does not report any harm caused by the AI system itself.

10 source articles · read the reporting →

WF-ZV5P971 Dec 2022

Cybercheck AI tool challenged in Akron homicide cases

Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.

Company involved
Akron Police Department
AI system involved
Cybercheck

3 source articles · read the reporting →

WF-BH561Z25 Sep 2026German

First Accident Before Test Phase: Robotaxis Launch in Furttal

Erster Unfall, bevor die Testphase beginnt: Robotaxis starten im Furttal - nzz.ch

Switzerland's first self-driving taxi service launched in the Furttal region near Zurich, but three days before the start a test vehicle had a minor accident in Dänikon, damaging a ground plate and two tires. The pilot project, called Iamo, aims to complement public transport, with a safety driver on board during the test phase.

Company involved
Swiss Transit Lab

1 source article · read the reporting →

WF-78F5YG31 May 2020

Chicago Police Used Altered ShotSpotter Evidence in Murder Case

In May 2020, ShotSpotter sensors detected a sound in Chicago and initially classified it as a firework. After police requested re-analysis, a ShotSpotter analyst manually reclassified the sound as a gunshot. The altered evidence was used to charge Michael Williams with murder. Williams' public defender filed a motion challenging the evidence's validity, and prosecutors subsequently withdrew the ShotSpotter evidence.

Company involved
Chicago Police Department
AI system involved
ShotSpotter

3 source articles · read the reporting →

Abbott issues correction for FreeStyle Libre 3 sensors over incorrect glucose readings

Abbott initiated a medical device correction for certain FreeStyle Libre 3 and Libre 3 Plus sensors after internal testing found they might give incorrect low glucose readings. The company says the issue stems from one production line and could lead to improper treatment decisions for people with diabetes. Abbott is replacing affected sensors at no charge and has reported severe adverse events and deaths potentially associated with the issue.

Company involved
Abbott
AI system involved
FreeStyle Libre 3 and FreeStyle Libre 3 Plus sensors

2 source articles · read the reporting →

Heathfield man sentenced in county's first AI-generated abusive image case

James Castell, 40, of Heathfield, was sentenced at Lewes Crown Court on 19 December after pleading guilty to possessing and distributing indecent images of children, including AI-generated pseudo-photographs. Sussex Police began investigating in October 2024 and found more than 3,800 images, along with AI image-generation software. He received an 18-month suspended sentence, a Sexual Harm Prevention Order, and was ordered to register as a sex offender.

3 source articles · read the reporting →

WF-GT2Y3225 Feb 2025

Bengaluru woman loses Rs 3.75 crore in Sadhguru deepfake investment scam

A 57-year-old retired woman in Bengaluru was defrauded of Rs 3.75 crore after scammers used an AI-generated deepfake video of spiritual leader Sadhguru Jaggi Vasudev to promote a fake investment platform called Mirrox. Between February and April 2025, she transferred the money across multiple transactions after being added to a WhatsApp group where fabricated profits were shared to build trust. She realised the fraud when she attempted to withdraw funds and the scammers demanded additional fees, then ceased communication. Police are coordinating with banks to freeze the fraudsters' accounts, but recovery is expected to be challenging.

Company involved
Mirrox
AI system involved
Mirrox stock trading app

2 source articles · read the reporting →

WF-HXYFPB12 Jun 2025

Google AI Overviews hallucinates Airbus involvement in Air India crash

Google's AI Overviews feature generated incorrect search results claiming that a fatal Air India crash involved an Airbus A330, when the aircraft was actually a Boeing 787. The error was spotted by a Reddit user and reported by Ars Technica. Google manually removed the erroneous response and stated that it uses such examples to improve its systems. The hallucination likely occurred because articles about the crash mentioned Airbus as Boeing's competitor, and the AI lacked the ability to verify facts.

Company involved
Google
AI system involved
AI Overviews

1 source article · read the reporting →

← Newerpage 12 of 13Older →