The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Butterfly Network” · matched on meaning · public reporting

WF-KA8YYL1 Sep 2024

AI transcription tool Otter.ai causes health data breach at Ontario hospital

A former physician at an Ontario hospital installed the Otter.ai transcription tool and gave it access to his digital calendar. Because his personal email was still on a meeting invite list, the AI agent autonomously joined a virtual hepatology round, transcribed it, and emailed the summary and transcript to 65 recipients. The transcript contained sensitive personal health information of seven patients. The hospital reported the breach to the Ontario IPC, took steps to contain it, and is implementing further safeguards.

Company involved
Unnamed hospital in Ontario
AI system involved
Otter.ai

6 source articles · read the reporting →

WF-99N8EL1 Mar 2020

Hundreds of AI tools built for covid proved unfit for clinical use

During the covid-19 pandemic, researchers worldwide developed hundreds of AI tools to diagnose or triage patients. Multiple reviews, including studies in the British Medical Journal and Nature Machine Intelligence, found that none of the 232 diagnostic or prognostic algorithms and 415 deep-learning models examined were fit for clinical use. Some tools were used in hospitals despite a lack of proper testing, and researchers fear they may have harmed patients. The failures are attributed to poor data quality, methodological errors, and a lack of collaboration between AI developers and clinicians.

Company involved
Various hospitals and private developers
AI system involved
Multiple unnamed AI diagnostic and prognostic tools

1 source article · read the reporting →

WF-DTVZ8927 Aug 2026

Covington cop fired after investigation into Flock technology system - WSB-TV

The system tracked vehicle locations and movements of individuals without legitimate law enforcement purpose.

Company involved
Covington Police Department
AI system involved
Flock

1 source article · read the reporting →

WF-DA2WQJ4 Feb 2021

False AIS tracks simulated for Swedish Navy vessels

An investigation by SkyTruth and Global Fishing Watch revealed that false automatic identification system (AIS) tracks were generated for nine Swedish Navy vessels on February 4-5, 2021. The Swedish Navy confirmed the positions were false. The false tracks appeared plausible and were indistinguishable from real AIS broadcasts, posing a threat to data integrity for marine monitoring.

AI system involved
Automatic Identification System (AIS)

10 source articles · read the reporting →

Hackers Got Inside a Flock Camera. Its Data Shows How the System Really Works - WIRED

The system captured images and data of passing vehicles and people.

Company involved
Flock Safety
AI system involved
Flock camera

1 source article · read the reporting →

Toronto AI swimmer warning experiment failed

The City of Toronto deployed an artificial intelligence system intended to warn swimmers. The experiment failed.

Company involved
City of Toronto

3 source articles · read the reporting →

WF-34YWVM20 Dec 2019

Facebook Removes Pro-Trump Network Using AI-Generated Faces

Facebook removed over 900 accounts, pages, and groups associated with The BL, a network that used AI-generated profile photos to spread pro-Trump content to 55 million users. Researchers from Graphika and DFRLab found that the network used generative adversarial networks to create fake faces, marking the first large-scale use of AI-generated images in an influence operation. The accounts were operated from Vietnam and the US, and were linked to The Epoch Times. Facebook's action came after the researchers identified the inauthentic activity.

Company involved
The BL

6 source articles · read the reporting →

WF-014H1J1 Mar 2026

A Georgia Cop Used Flock to Track 2 Other Cops: His Ex and Her Friend - WIRED

The system tracked the vehicle locations of a former romantic partner and a fellow police officer.

Company involved
Alpharetta Police Department
AI system involved
Flock Safety

1 source article · read the reporting →

WF-CRBH9Y3 Apr 2025

Flock Safety failed to secure Boston vehicle data during 2025 pilot, report finds - WBUR

Flock Safety cameras collected license plate and vehicle data from drivers in Boston and shared it with external law enforcement agencies.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

WF-JCS1A01 Jul 2025

Lieff Cabraser and Greer Injury Lawyers Announce Federal Class Action Lawsuit Against X.AI Corp and MZX Tech LLC for Nuisance,…

The data centers and gas turbines emitted constant noise, vibrations, and particulate matter, affecting residents' ability to use and enjoy their properties.

Company involved
X.AI Corp and MZX Tech LLC
AI system involved
Colossus I, Colossus II, MACROHARDRR, Minihard data centers and gas turbines

1 source article · read the reporting →

WF-7HYWB51 Jan 2022

Acclarent's AI-Powered Surgery Tool Allegedly Injures Patients, Lawsuits Claim

Two patients allege that Acclarent's TruDi Navigation System, which uses AI to confirm device positioning during sinus surgery, misled surgeons and caused severe injuries including strokes. The FDA has received over 100 reports of malfunctions and at least ten injuries since AI was added. Lawsuits claim the company rushed the technology to market with only 80% accuracy, making the device less safe than before. Acclarent denies any causal connection, and the cases are ongoing.

Company involved
Acclarent
AI system involved
TruDi Navigation System

2 source articles · read the reporting →

WF-4MF24H14 Sep 2026

Hackers breach Flock camera data, share findings with media - NBC Montana

The Flock camera system photographed and tracked vehicles and individuals, generating millions of images and license plate data for law enforcement use.

Company involved
Flock
AI system involved
Flock camera

1 source article · read the reporting →

WF-A5KN2K6 May 2024

Google's Med-Gemini AI Hallucinates Non-Existent Body Part in Brain Scan

In a 2024 research paper, Google's Med-Gemini AI model generated a radiology report diagnosing an 'old left basilar ganglia infarct', a non-existent body part conflating the basal ganglia and basilar artery. The error was not caught by Google before publication. After a neurologist flagged the mistake, Google quietly edited a blog post to correct the term, calling it a typo, but the research paper remains unchanged. Experts warn that such hallucinations pose significant risks if doctors fail to notice them in clinical settings.

Company involved
Google
AI system involved
Med-Gemini

1 source article · read the reporting →

WF-4DGQE71 Jan 2022

Acclarent's AI-Powered Surgery Tool Allegedly Injures Patients, Lawsuits Claim

The TruDi Navigation System by Acclarent, which uses AI to confirm device positions during sinus surgery, has been linked to at least ten patient injuries including strokes, according to FDA reports and two lawsuits. Plaintiffs Erin Ralph and Donna Fernihough allege that the AI was inaccurate and misled surgeons, causing carotid artery damage and strokes in 2022. Acclarent denies the allegations, stating there is no credible evidence of a causal connection. The lawsuits are ongoing.

Company involved
Acclarent
AI system involved
TruDi Navigation System

2 source articles · read the reporting →

WF-7SKCJ430 Dec 2025

MeetingTV sues Palo Alto Networks' Koi Security over AI-hallucinated threat report

MeetingTV, a video conferencing startup, alleges that Koi Security used an AI system to generate a threat report that falsely linked it to a Chinese espionage operation. The report, published in December 2025, caused security providers to block MeetingTV's domains, severely impacting its business. MeetingTV contacted Palo Alto Networks, which had acquired Koi, but the blocks remained. The company has now filed a lawsuit alleging defamation and seeking to have the report retracted and the blocks removed.

Company involved
Koi Security
AI system involved
Wings

2 source articles · read the reporting →

WF-7VTX841 Dec 2021

Giggle App's AI Facial Recognition Excludes Trans Women and Women of Color

Giggle, a social media app for 'females', uses Kairos facial recognition AI to verify users' gender, allowing access only if the AI is 95% certain the person is female. The app intentionally excludes transgender women, and its AI has been criticised for misgendering women of colour due to known racial biases in facial analysis. Trans women who initially joined were later banned by CEO Sall Grover, who embraces TERF ideology. The incident highlights discrimination and the harms of using imperfect AI for gatekeeping.

Company involved
Giggle
AI system involved
Giggle

2 source articles · read the reporting →

WF-LYHNTC1 Jul 2026

Montefiore Allegedly Plans to Replace Nurses with AI for Insurance Reviews

The New York State Nurses Association alleges that Montefiore Health System plans to lay off 12 utilization review nurses and replace them with AI-powered software from Datavant. The union warns that the move could compromise patient care by having AI review insurance denials without clinical judgement. Montefiore denies the claims, stating they are investing in technology for better outcomes. The plan has sparked a town hall and calls from elected officials to halt the layoffs.

Company involved
Montefiore Health System

3 source articles · read the reporting →

WF-ZZHCAE1 Jun 2017

IBM Watson for Oncology recommended unsafe cancer treatments

Internal IBM documents reveal that its Watson for Oncology system often provided erroneous cancer treatment advice, including 'multiple examples of unsafe and incorrect treatment recommendations'. The problems were attributed to training on a small number of synthetic cases and the expertise of a few specialists rather than real patient data or established guidelines. The system was promoted to hospitals and physicians worldwide. It is unclear whether any patients were harmed as a result.

Company involved
IBM
AI system involved
Watson for Oncology

2 source articles · read the reporting →

Life360 sells precise location data of millions of users to data brokers

Life360, a family safety app used by 33 million people, sells precise location data of its users to approximately a dozen data brokers, according to interviews with former employees. The company removes obvious identifiers but does not adequately anonymize the data, allowing potential re-identification. Life360 announced it will stop sales to some brokers after the investigation.

Company involved
Life360
AI system involved
Life360 app

10 source articles · read the reporting →

Commercial network in Sri Lanka uses AI-generated anti-migrant content targeting UK

ISD and TBIJ identified a network of over 100 Facebook pages and groups run from Sri Lanka that spread AI-generated anti-migrant content to UK audiences for profit. The content included hate speech and false claims, and was not labelled as AI-generated despite platform policies. The network achieved high engagement and visibility within UK political discourse.

10 source articles · read the reporting →

Ukraine defence ministry uses Clearview AI facial recognition to identify dead and Russian assailants

Ukraine's defence ministry has started using Clearview AI's facial recognition technology to identify Russian assailants and the dead, according to reports. Clearview provided free access to its system, which holds over 10 billion images including from Russian social media. Critics warn that the technology could misidentify people at checkpoints and in battle, potentially harming civilians. Clearview says it should not be used as the sole source of identification.

Company involved
Ukraine's Ministry of Defense
AI system involved
Clearview AI

10 source articles · read the reporting →

Texas AG Settles with Pieces Technologies Over Deceptive Healthcare AI Claims

The Texas Attorney General investigated Pieces Technologies, a Dallas-based healthcare AI company, for making false and misleading statements about the accuracy of its generative AI product used in hospitals. The company claimed an error rate of less than 1 per 100,000, but the investigation found these metrics were likely inaccurate. As part of the settlement, Pieces agreed to accurately disclose its product's accuracy and ensure hospital staff understand the appropriate reliance on its AI. The case marks the first-of-its-kind healthcare generative AI investigation by the AG.

Company involved
Pieces Technologies

4 source articles · read the reporting →

WF-W7U79Y20 Dec 2024

Russian disinformation network Matryoshka uses AI deepfakes on Bluesky

The Russian disinformation network 'Matryoshka' has launched a campaign on Bluesky, posting AI-generated videos that impersonate academics to spread anti-Ukraine narratives. The videos use AI to replicate the voices of real professors, making false claims about the war. The campaign was detected by Bellingcat founder Eliot Higgins and the Bot Blocker project. The videos have gained limited traction on Bluesky so far, but researchers warn the platform is more vulnerable to such disinformation.

Company involved
Matryoshka (Russian disinformation network)

3 source articles · read the reporting →

WF-KZAA8P1 Jan 2021

UK study finds AI cannot detect COVID-19 from cough sounds

The UK Department of Health and Social Care awarded contracts to Fujitsu to develop a "Cough In A Box" app that would use AI to detect COVID-19 from cough sounds, based on earlier claims of high accuracy. However, a study led by the Alan Turing Institute found that machine learning models could not accurately predict COVID-19 from coughs due to confounding variables. The study concluded that the technology does not work for COVID-19 diagnosis.

Company involved
UK Department of Health and Social Care
AI system involved
Cough In A Box

10 source articles · read the reporting →

page 1 of 2Older →