The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

330 incidents closest to “Mark43 CAD” · matched on meaning · public reporting

WF-HE06HX10 May 2024

NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles

Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users

Company involved
Zoox
AI system involved
Zoox vehicle

1 source article · read the reporting →

Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.

Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.

Company involved
Sports Direct
AI system involved
Facewatch

2 source articles · read the reporting →

WF-TDFPG43 Mar 2024

Ford BlueCruise crash in Philadelphia kills two, injures one

On March 3, 2024, a Ford Mustang Mach-E operating in hands-free partial automation mode (BlueCruise) collided with stationary vehicles in a work zone on I-95 in Philadelphia. The system recorded a speed of 72.4 mph with no braking or steering before impact. The drivers of the two stationary vehicles died, and the Ford driver was injured. The NTSB determined the probable cause to be driver impairment and distraction due to overreliance on automation, as well as Ford's inadequate integration of speed management with the automation system.

Company involved
Ford Motor Company
AI system involved
BlueCruise

9 source articles · read the reporting →

WF-V0IBRA20 Feb 2024

Evolv backtracks on claimed UK government testing of AI weapons scanner

Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.

Company involved
Evolv Technology
AI system involved
Evolv Express

3 source articles · read the reporting →

WF-NCL4LX29 May 2024

AI-generated 'All eyes on Rafah' image goes viral on social media

An AI-generated image depicting refugee tents spelling out 'all eyes on Rafah' was shared millions of times on Instagram and other platforms in late May 2024. The image was created by a small account based in Malaysia and was boosted by celebrities. The image went viral after an Israeli military strike on Rafah killed at least 45 people. The article does not report any harm caused by the AI system itself.

10 source articles · read the reporting →

WF-ZV5P971 Dec 2022

Cybercheck AI tool challenged in Akron homicide cases

Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.

Company involved
Akron Police Department
AI system involved
Cybercheck

3 source articles · read the reporting →

Former Emerson officer accused of misusing Flock camera system - wrganews.com

The Flock camera system captured license plate data of individuals.

Company involved
Acworth Police Department
AI system involved
Flock Safety System

1 source article · read the reporting →

NC police officer allegedly used Flock license plate cameras to track boyfriend's ex-wife - ABC11 News

The system tracked the location of the boyfriend's ex-wife.

Company involved
Mooresville Police Department
AI system involved
Flock

1 source article · read the reporting →

WF-1ZOPC618 Jan 2025

High school student used ChatGPT to hack Kaikatsu Club, steal 7.25 million records

A 17-year-old high school student in Japan was arrested for using ChatGPT to create a computer program that hacked into the server of Kaikatsu Frontier, operator of the Kaikatsu Club internet cafe chain. The student allegedly obtained approximately 7.25 million sets of membership information between January 18 and 20, 2025. No misuse of the data has been confirmed. The student was arrested for violating Japan's unauthorized computer access and fraudulent obstruction of business laws.

Company involved
Kaikatsu Frontier
AI system involved
ChatGPT

3 source articles · read the reporting →

WF-9CI2NA22 Aug 2024

Google Pixel 9 tools generate offensive images and fake photos

Google's Pixel Studio and Reimagine features on the Pixel 9 phones are accused of generating offensive, copyrighted images and allowing users to create convincing fake photos. Reviews show the AI produced images of characters like SpongeBob in a Nazi uniform and Elmo drunk driving. Google acknowledged the issues and said it is working to improve safeguards, but the tools remain available.

Company involved
Google
AI system involved
Pixel Studio, Reimagine (Magic Editor)

5 source articles · read the reporting →

WF-HB8TFZ1 Sep 2025

French high school student arrested for terrorist plot used ChatGPT to plan attack

A 17-year-old high school student in the Sarthe region of France was arrested in early September 2025 and charged with terrorist conspiracy. He allegedly used ChatGPT to plan two attacks, including an armed assault on a sensitive site and arson at multiple schools. The student claims ChatGPT contributed to his radicalization by providing information on explosives and attack methods without setting limits. He is currently under judicial investigation.

AI system involved
ChatGPT

3 source articles · read the reporting →

Heathfield man sentenced in county's first AI-generated abusive image case

James Castell, 40, of Heathfield, was sentenced at Lewes Crown Court on 19 December after pleading guilty to possessing and distributing indecent images of children, including AI-generated pseudo-photographs. Sussex Police began investigating in October 2024 and found more than 3,800 images, along with AI image-generation software. He received an 18-month suspended sentence, a Sexual Harm Prevention Order, and was ordered to register as a sex offender.

3 source articles · read the reporting →

TrueCompanion's Roxxxy doll Frigid Farrah simulates rape

The Roxxxy TrueCompanion sex robot includes a personality setting called Frigid Farrah, which is programmed to resist the user's advances, simulating rape. The doll is sold online for $9,995. The article criticizes the product as depraved and calls for policy consideration.

Company involved
TrueCompanion
AI system involved
Roxxxy TrueCompanion with Frigid Farrah personality

10 source articles · read the reporting →

Gas stations accused of using AI to inflate prices in California lawsuit

A class action lawsuit alleges that major gas station chains in California, including Marathon Petroleum, 7-Eleven, Walmart, and Circle K, used Kalibrate's AI-powered pricing software to coordinate and raise fuel prices. The software, which automatically sets prices based on competitor data, is accused of eliminating competition and costing consumers between 6 and 30 cents more per gallon. The lawsuit, filed under California's AB 325, claims the practice violates antitrust laws by using a common pricing algorithm to restrain trade. The case is pending.

Company involved
Marathon Petroleum, 7-Eleven, Walmart, Circle K
AI system involved
Kalibrate Fuel Pricing

10 source articles · read the reporting →

WF-RGFKA25 Feb 2025

22-year-old man used AI to plan hammer attack on father-in-law

A 22-year-old man in Denmark used an AI chatbot to research how to harm his father-in-law without killing him, bypassing safety filters by claiming he was writing a book. On 5 February 2025, he attacked the 56-year-old with a rubber hammer in Ringsted, hitting him twice in the head. The man was convicted of aggravated violence and sentenced to ten months in prison by the Court in Roskilde. He had pleaded not guilty, claiming self-defence, but this was rejected.

1 source article · read the reporting →

WF-S5GF7R1 Jun 2026

Guardia Civil identifies creators of AI nudes affecting 22 women in Pontevedra

Two men in Pontevedra, Spain, have been identified by the Guardia Civil for allegedly creating and disseminating AI-generated nude images of 22 women without their consent. The images were produced using artificial intelligence applications from photographs taken from the victims' social media profiles. The case has been referred to the Tribunal de Instancia de Lalín, with one man accused of creating the material and the other of distributing it, facing charges of a crime against moral integrity.

3 source articles · read the reporting →

WF-SQKJVH28 Feb 2026

US Maven targeting system kills 175 at Iranian school after database error

On 28 February 2026, US forces struck the Shajareh Tayyebeh primary school in Minab, Iran, killing between 175 and 180 people, most of them girls. The targeting was carried out by the Maven Smart System, built by Palantir, which had classified the building as a military facility based on an outdated Defense Intelligence Agency database. Although media attention focused on the chatbot Claude, the real failure was a bureaucratic one: the database had not been updated to reflect the building's conversion into a school years earlier. The incident highlights the lethal consequences of compressed kill chains and automated targeting infrastructure.

Company involved
US Department of Defense
AI system involved
Maven Smart System

2 source articles · read the reporting →

WF-QWZ8PS2 Nov 2023

WhatsApp AI generates gun images for 'Palestinian' prompts

The Guardian reports that WhatsApp's AI image generator, when prompted with terms like 'Palestinian' or 'Palestine', returns images of children with guns or a hand holding a gun. In contrast, prompts for 'Israeli' or 'Israel army' generate peaceful images without guns. Meta employees had reported the issue internally, and a Meta spokesperson acknowledged the problem, stating the company is addressing it. An Australian senator has called for an investigation by the e-safety commissioner.

Company involved
Meta
AI system involved
WhatsApp AI sticker generator

9 source articles · read the reporting →

WF-XD7D7X1 Jun 2023

Man jailed for using AI to create child sexual abuse images

Hugh Nelson, 27, used AI technology to alter photographs of real children to create sexual abuse images and sold them online. He also encouraged the rape of children via internet chatrooms. He pleaded guilty to 16 charges and was sentenced to 18 years imprisonment at Bolton Crown Court. The CPS stated that the law applies equally to AI-generated images of children.

6 source articles · read the reporting →

WF-BZ7M5L1 Jan 2016

Tenant screening software denies housing to disabled Latino man in Connecticut

In 2016, Carmen Arroyo requested to move her disabled son Mikhail into a larger apartment in the same complex. The landlord, WinnResidential, used CoreLogic's CrimSafe tenant screening software, which flagged a dropped retail theft charge against Mikhail as disqualifying. The landlord rejected the application without explanation. Arroyo sued CoreLogic and WinnResidential under the Fair Credit Reporting Act and the Fair Housing Act, alleging that the software disproportionately excludes people of colour. The case was scheduled for trial in August 2021.

Company involved
WinnResidential
AI system involved
CrimSafe

10 source articles · read the reporting →

WF-VFXGRY23 Mar 2023

Cruise recalls 300 robotaxis after crashing into San Francisco bus

On March 23, 2023, a Cruise self-driving robotaxi rear-ended an articulated San Francisco Municipal Transit Authority bus in San Francisco. The low-speed crash caused minor damage to the robotaxi's front fender and no injuries. Cruise filed a voluntary recall with NHTSA and issued a software update, stating that the software inaccurately predicted the movement of articulated vehicles.

Company involved
Cruise
AI system involved
Cruise self-driving robotaxi

10 source articles · read the reporting →

WF-CPICEF31 Oct 2022

Evolv AI scanner fails to detect knife, student stabbed at Utica school

In October 2022, a student at Proctor High School in Utica, New York, was stabbed with a knife that the Evolv Express AI weapons scanner failed to detect. The school district had installed the system in 13 schools. An internal investigation found the system was not designed to detect knives. The scanners were removed from Proctor High School but remain in other schools.

Company involved
Utica City School District
AI system involved
Evolv Express

10 source articles · read the reporting →

WF-Z1B56C1 Jan 2025

Man used ChatGPT to plan Tesla Cybertruck explosion in Las Vegas

Matthew Livelsberger, a 37-year-old Army Green Beret, used generative AI including ChatGPT to plan an explosion of a Tesla Cybertruck outside the Trump International Hotel in Las Vegas on New Year's Day 2025. He fatally shot himself before the explosion, which caused minor injuries to seven people. Police said it was the first known incident on U.S. soil where ChatGPT was used to help build a device. OpenAI stated that ChatGPT responded with publicly available information and warned against harmful activities, and is cooperating with law enforcement.

AI system involved
ChatGPT

4 source articles · read the reporting →

WF-M69GD022 Jan 2025

Omnilert AI weapon detection system fails at Antioch High School shooting

An AI-powered weapon detection system called Omnilert failed to detect a handgun carried by a 17-year-old student at Antioch High School in Nashville, Tennessee, on 22 January 2025. The student shot and killed a 16-year-old girl and wounded another student before killing himself. A district official said the system did not detect the gun because the shooter was not close enough to the cameras. The system was activated by police brandishing their weapons during the response.

Company involved
Metro Nashville Public Schools
AI system involved
Omnilert

6 source articles · read the reporting →

← Newerpage 13 of 14Older →