The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

236 incidents closest to “Mark43 Insights” · matched on meaning · public reporting

WF-IJU2642 Mar 2026

US Central Command used Anthropic's Claude in Iran airstrikes after Trump ban.

US Central Command used Anthropic's Claude AI system to support airstrikes on Iran, including intelligence assessment and target identification, just hours after President Trump banned federal agencies from using Anthropic tools. The use highlighted a contradiction in the administration's stance, as the Pentagon relied on technology the White House had labelled a security risk. Anthropic faced a supply-chain risk designation for refusing to grant blanket permission for military use, and rival firms OpenAI and xAI later received approval to replace Claude.

Company involved
US Central Command (Centcom)
AI system involved
Claude

4 source articles · read the reporting →

WF-MJJJVQ1 Jan 2023

Durham's ShotSpotter fails to detect two deadly shootings

ShotSpotter, a gunshot detection system piloted by the Durham Police Department, failed to detect two fatal shootings in February 2023, as well as a New Year's Day shooting that injured five. The system, which uses sensors and human review to alert police, did not send alerts for these incidents within its three-square-mile coverage area. The company stated it investigated and provided a report to the police, while a city official defended the pilot, noting it is still early in the year-long trial. Community concerns have been raised about increased police presence and potential racial profiling.

Company involved
Durham Police Department
AI system involved
ShotSpotter

5 source articles · read the reporting →

WF-H3NHGW1 Jan 2020

GoLaxy Used AI to Manipulate Public Opinion in Hong Kong and Taiwan

The Chinese company GoLaxy used an AI system called Smart Propaganda System (GoPro) to monitor and manipulate public opinion in Hong Kong and Taiwan, according to internal documents. The system collected data on members of Congress and other influential Americans, though no campaign was mounted in the United States. GoLaxy denied the allegations, calling them misinformation. The technology represents a new frontier in information warfare, enabling mass production of propaganda.

Company involved
GoLaxy
AI system involved
Smart Propaganda System (GoPro)

2 source articles · read the reporting →

School AI surveillance like Gaggle can lead to false alarms, arrests

AI surveillance tools used in schools, such as Gaggle, GoGuardian and Bark, are reported to generate false alarms that have led to student arrests. The article examines cases where automated monitoring flagged innocent behaviour as threats, causing harm to students and families.

2 source articles · read the reporting →

WF-333WY81 May 2025

Philip Morris accused of using AI to rig EU tobacco consultation responses

Dutch broadcasters Pointer and NOS allege that Philip Morris International used an AI-powered platform, 'Your Voice, Your Choice', to generate responses to the European Commission's public consultation on tobacco legislation. The platform offered pre-defined responses and AI assistance, leading to an estimated 30 per cent of all responses being AI-generated. Philip Morris denies wrongdoing, stating that users retained full control and that anti-tobacco lobbyists are attempting to discredit legitimate participation. The incident raises concerns about the integrity of EU democratic processes.

Company involved
Philip Morris International
AI system involved
Your Voice, Your Choice

4 source articles · read the reporting →

WF-R41UQV23 Feb 2012

Palantir secretly tested predictive policing in New Orleans

Beginning in 2012, Palantir Technologies secretly partnered with the New Orleans Police Department to deploy a predictive policing system. The programme analysed gang affiliations, social media and criminal histories to forecast individuals’ likelihood of committing or becoming victims of violence, operating without public knowledge or city council oversight. Researchers and law enforcement officials raised concerns about systemic bias and civil liberties. As of 2018, the city and Palantir had not disclosed the programme’s status.

Company involved
New Orleans Police Department

1 source article · read the reporting →

Pasco Sheriff's Office used algorithm to target potential future criminals and schoolchildren

The Pasco Sheriff's Office operates an intelligence-led policing programme that uses an algorithm to identify people who might break the law based on criminal histories and social networks. Deputies are sent to the homes of those flagged, even without evidence of a crime, and former deputies allege they were ordered to make targets' lives miserable. The agency also keeps a list of more than 400 schoolchildren predicted to 'fall into a life of crime', built from data such as grades and child welfare records, without informing the children or their parents. Civil liberties groups are considering lawsuits and public advocacy campaigns, and experts have called the programmes 'morally repugnant'.

Company involved
Pasco Sheriff's Office

10 source articles · read the reporting →

Adobe Firefly trained on thousands of Midjourney images, Bloomberg reports

Bloomberg has reported that Adobe's Firefly image generator was trained using thousands of images from competitor Midjourney. Adobe says these made up about 5% of the training data and were part of the Adobe Stock library. The company has marketed Firefly as ethically trained and offered enterprise customers indemnity against copyright claims. Adobe responded that all Adobe Stock images undergo moderation, but the report has raised questions about Firefly's copyright safety.

Company involved
Adobe
AI system involved
Firefly

7 source articles · read the reporting →

WF-6J4R0P1 Feb 2024

OpenAI disrupts five covert influence operations using AI models

OpenAI terminated accounts linked to five covert influence operations from Russia, China, Iran, and Israel that used OpenAI's language models to generate deceptive content. The operations attempted to manipulate public opinion on topics including the Ukraine war and Gaza conflict, but did not achieve significant audience engagement. OpenAI shared threat indicators with industry peers.

AI system involved
OpenAI language models

9 source articles · read the reporting →

WF-HF1YRW1 Sep 2023

Xuhui police expand facial recognition surveillance to profile 1.1 million residents

The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.

Company involved
Shanghai Municipal Bureau of Public Security, Xuhui District Branch
AI system involved
Intelligent Image Recognition System

3 source articles · read the reporting →

WF-7523R67 Jan 2026

X's Grok AI falsely 'unmasks' ICE agent, leading to harassment of two men

After the fatal shooting of Renee Good by an ICE agent in Minneapolis, users on X asked the AI chatbot Grok to 'unmask' the agent. Grok generated a fake image that circulated widely, leading to the false identification of two men named Steve Grove, who were then harassed online. Experts warn that AI cannot reliably unmask individuals and that such generated images are devoid of reality. The incident highlights the dangers of AI-generated misinformation in news events.

Company involved
X
AI system involved
Grok

1 source article · read the reporting →

West Midlands Police test NDAS system to assess crime risk

West Midlands Police are testing a system called the National Data Analytics Solution (NDAS) that analyses police data to assess the risk of individuals committing a crime or becoming a victim. The Home Office has funded the project with millions of pounds, intending to roll it out across England and Wales. Critics warn that the system could reinforce bias against minorities and undermine the presumption of innocence. The police say the technology is designed to support, not replace, officer decision-making and that it is still in early testing.

Company involved
West Midlands Police
AI system involved
National Data Analytics Solution

1 source article · read the reporting →

WF-H9OY8625 Sep 2024

Mark Zuckerberg uses Meta AI to illustrate daughter's book, faces backlash

Mark Zuckerberg used Meta AI to generate illustrations for a children's book written by his six-year-old daughter, August. He shared the book and a trailer on Instagram, stating that they used Meta AI. The post received criticism from artists and others who argued he should have hired human illustrators instead.

AI system involved
Meta AI

5 source articles · read the reporting →

Pentagon Used Anthropic's Claude in Maduro Venezuela Raid

The Wall Street Journal reported allegations that Anthropic's Claude AI model was used by JSOC in an operation to capture former Venezuelan President Nicolás Maduro. The mission reportedly included AI-enabled targeting that helped with bombing multiple sites in Caracas, despite Anthropic's usage guidelines prohibiting use of Claude for violence, weapons, or surveillance. Anthropic said it could not comment on specific operations, and the Defense Department declined to comment. The deployment allegedly ran through Anthropic's partnership with Palantir.

Company involved
Pentagon
AI system involved
Claude

4 source articles · read the reporting →

WF-DWBKBN1 Jan 2019

Las Vegas police used unsuitable facial recognition images in nearly half of searches

The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.

Company involved
Las Vegas Metropolitan Police Department
AI system involved
Vigilant Solutions facial recognition system

1 source article · read the reporting →

WF-ZW37ZY31 Oct 2023

Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians

In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.

Company involved
Israel Defense Forces

3 source articles · read the reporting →

WF-CDY4BR1 Jul 2024

Perplexity AI Misdiagnosis Leads to Man's Death After He Avoids Cancer Treatment

Benjamin Riley's father, a former neuroscientist, used Perplexity AI to self-diagnose his chronic lymphocytic leukemia and was incorrectly told he had Richter's Transformation, leading him to refuse his oncologist's recommended Ven-Obi treatment for a year. Despite his son's efforts to correct the misinformation by contacting the study authors, the father's condition worsened, and he eventually started treatment but died weeks later. The incident highlights the dangers of relying on AI for medical advice.

Company involved
Perplexity AI
AI system involved
Perplexity AI

1 source article · read the reporting →

WF-GY0FZ528 Aug 2025

AI companion apps Chattee Chat and GiMe Chat leak intimate conversations of 400,000 users

Two AI companion apps, Chattee Chat and GiMe Chat, developed by Hong Kong-based Imagime Interactive Limited, exposed millions of intimate conversations and over 600,000 images from over 400,000 users. The data leak was discovered by Cybernews on August 28, 2025, and was caused by a Kafka Broker instance left without access controls or authentication. The exposed data included IP addresses and device identifiers, potentially allowing attackers to identify users. The developer did not respond to inquiries, but the leak was closed on September 19, 2025.

Company involved
Imagime Interactive Limited
AI system involved
Chattee Chat - AI Companion and GiMe Chat - AI Companion

4 source articles · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-EBCCF530 Jun 2020

Miami Police Used Clearview AI to Identify Protester

NBC 6 Investigators revealed that Miami Police used the facial recognition program Clearview AI to identify Oriana Albornoz, a 25-year-old woman, as the person accused of throwing rocks at officers during a protest on May 30, 2020. She was arrested a month later and charged with battery on a police officer; her attorney said he was unaware police had used the technology, as it was not disclosed in the arrest report. The police department acknowledged using Clearview AI to identify violent protest suspects after the fact, but stated they do not surveil peaceful protesters. The case is ongoing, with Albornoz pleading not guilty.

Company involved
Miami Police Department
AI system involved
Clearview AI

4 source articles · read the reporting →

New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com

The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.

Company involved
Meta Platforms
AI system involved
Meta AI-enabled Ray-Ban and Oakley smart glasses

1 source article · read the reporting →

WF-37U45J1 Nov 2023

Fort Myers man falsely arrested; lawsuit says AI program is to blame - WINK News

Police falsely arrested an innocent man due to a facial recognition misidentification

Company involved
Jacksonville Beach Police Department
AI system involved
FACESNXT

1 source article · read the reporting →

WF-Z8XGSC20 Jul 2025

Hallucination-laced TRO raises alarm bells on AI use by courts - Massachusetts Lawyers Weekly

A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.

Company involved
U.S. District Court for the Southern District of Mississippi

1 source article · read the reporting →

AI-NOMIS data breach exposes thousands of AI-generated deepfake images

Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.

Company involved
AI-NOMIS
AI system involved
GenNomis

5 source articles · read the reporting →

← Newerpage 9 of 10Older →