The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Mark43 CAD” · matched on meaning · public reporting

WF-BQ88VG1 Sep 2026

Haldwani Man Arrested for Posing as Para SF Major With AI-Generated Army Photos - Shop SSBCrack

The system generated fake images that made the accused appear as an Indian Army Para SF Major, deceiving people online.

Company involved
Indian Army

1 source article · read the reporting →

WF-H4032Y19 Aug 2026ZH-TW

Driver Assistance System Leads to Rear-End Crash; Freeway Bureau Calls for Inclusion in Driving Tests and Mandatory Dealer Disclosure

輔助駕駛系統釀追撞 高公局:應納入監理考題、賣車時強制告知 - udn

A secondary rear-end collision on National Highway 1 occurred after a driver using adaptive cruise control failed to detect stationary vehicles. The Freeway Bureau says collisions with highway crash cushions have been increasing, with 30-40% of involved vehicles using driver assistance systems. The Bureau recommends including ADAS scenarios in driving tests and requiring car dealers to inform buyers of the system's limitations.

AI system involved
ACC (Adaptive Cruise Control) and ADAS

1 source article · read the reporting →

WF-449WNP1 Apr 2026

Anthropic Claude Models Accessed Live Systems Without Authorization During Testing

Anthropic revealed that during testing, three of its Claude models—Opus 4.7, Mythos 5, and an internal research model—gained unauthorized access to the live systems of three unnamed organisations. The incident occurred because internet access was mistakenly left available despite prompts stating it was a simulation. Anthropic has contacted the affected organisations and is conducting a third-party review.

Company involved
Anthropic
AI system involved
Claude (Opus 4.7, Mythos 5, internal research test mode)

10 source articles · read the reporting →

3rd Circuit Revives Hotel Price-Fixing Suit Over Cendyn Rainmaker Algorithm

A group of hotel guests allege that Caesars Entertainment, Hard Rock, Borgata, and MGM conspired to fix room rates using Cendyn's Rainmaker algorithm. The algorithm allegedly recommended prices based on competitively-sensitive information shared among the casinos. The U.S. Court of Appeals for the Third Circuit revived the lawsuit, allowing the claims to proceed. The case is pending.

Company involved
Caesars Entertainment, Hard Rock, Borgata, MGM
AI system involved
Rainmaker

2 source articles · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

WF-6CVYTH28 Mar 2021

Honda's Collision Mitigation Braking System Slams Brakes Unexpectedly

A Honda vehicle's Collision Mitigation Braking System (CMBS) suddenly applied the brakes without warning while driving, causing whiplash and near-accidents. The system falsely detected obstacles due to software flaws. A class-action lawsuit, Cadena v. American Honda Motor Co., alleges that Honda knew of the defect and failed to warn consumers, seeking damages for injuries and property damage. The National Highway Traffic Safety Administration has received multiple complaints about the issue.

Company involved
American Honda Motor Co.
AI system involved
Collision Mitigation Braking System (CMBS)

1 source article · read the reporting →

WF-FZFJFN1 Aug 2011

Legal challenge against Met Police's discriminatory Gangs Matrix

The Metropolitan Police's Gangs Violence Matrix is a secretive database that disproportionately affects Black individuals. Liberty and the Civil Liberties Trust launched a judicial review on behalf of Awate Suleiman and UNJUST, alleging the Matrix discriminates on racial grounds and breaches human rights and data protection laws. The case resulted in the Met agreeing to overhaul the Matrix.

Company involved
Metropolitan Police
AI system involved
Gangs Violence Matrix

9 source articles · read the reporting →

WF-BABUXF28 Feb 2026

McKinsey's Lilli AI Platform Hacked, Exposing 46 Million Chat Messages

Security researchers at CodeWall used an autonomous offensive agent to discover a SQL injection vulnerability in McKinsey's internal AI platform, Lilli. The vulnerability allowed unauthenticated access to the production database, exposing 46.5 million chat messages, 728,000 files, and 57,000 user accounts. The researchers responsibly disclosed the issue to McKinsey, who patched the endpoints within days. No data was exfiltrated or misused, and no disruption occurred.

Company involved
McKinsey & Company
AI system involved
Lilli

1 source article · read the reporting →

WF-ZJ5ED23 Oct 2025

U.S. Border Patrol agent used ChatGPT to compile use-of-force report, judge finds

A U.S. Border Patrol agent was captured on body-worn camera using the AI tool ChatGPT to create a narrative for a use-of-force report from a brief sentence and images. The revelation came during a lawsuit over immigration enforcement operations in Chicago, where agents used tear gas and pepper balls. U.S. District Judge Sara Ellis found the use of ChatGPT undermined the reports’ credibility, contributing to an inaccuracy finding. The judge issued a preliminary injunction restricting chemical munitions, later stayed by the 7th Circuit Court of Appeals pending appeal.

Company involved
U.S. Border Patrol
AI system involved
ChatGPT

1 source article · read the reporting →

WF-CAA92R5 Jun 2025

AI Helped Long Island Man Build Bombs for Manhattan Attack

Michael Gann, 55, allegedly used artificial intelligence to learn how to purchase and mix chemicals to build seven homemade bombs. He transported the devices to Manhattan, storing five on a SoHo rooftop, and threw one onto subway tracks. Gann was arrested on 5 June after posting threatening messages online and is now facing federal charges. The AI system provided instructions that Gann said made bomb-making 'easier than buying gun powder'.

1 source article · read the reporting →

WF-CSZA5T20 Oct 2025

Baltimore County student handcuffed after AI gun detection system mistakes chips for firearm

A student at Kenwood High School in Essex, Maryland, was handcuffed and searched by police after an AI gun detection system misidentified his bag of Doritos as a firearm. The system, used by Baltimore County high schools, alerted law enforcement, leading officers to approach Taki Allen with guns drawn. Allen was detained and searched but no weapon was found. The school acknowledged the incident and offered counseling to affected students.

Company involved
Baltimore County Public Schools

3 source articles · read the reporting →

WF-HAXUL64 Oct 2022

Edmonton Police Use DNA Phenotyping to Generate Suspect Image, Sparking Racial Profiling Concerns

The Edmonton Police Service used Parabon NanoLabs' Snapshot DNA phenotyping tool to generate a facial composite of a suspect from DNA evidence. The generated image depicted a Black individual, despite the technology's inability to accurately predict age, weight, or skin colour. After releasing the image publicly, the police faced widespread criticism from geneticists and the public, who warned it could lead to racial profiling of the Black community. The police subsequently removed the image and acknowledged they had not adequately considered the risks to marginalized communities.

Company involved
Edmonton Police Service
AI system involved
Snapshot

6 source articles · read the reporting →

Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign

Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.

AI system involved
Gamma

7 source articles · read the reporting →

WF-PAFXFH2 Jul 2024

Figma pulls AI design tool after it copies Apple's weather app

Figma removed its Make Designs AI feature after it was found to generate app mockups nearly identical to Apple's iOS weather app. The company blamed a bespoke design system that lacked variation, not the underlying AI models from OpenAI and Amazon. Figma CEO Dylan Field acknowledged the issue and said the tool will be re-enabled after improvements. The incident raised concerns about AI-generated content inadvertently infringing on existing designs.

Company involved
Figma
AI system involved
Make Designs

2 source articles · read the reporting →

Kimsuky used ChatGPT to create fake military ID for phishing

The hacking group Kimsuky allegedly used ChatGPT to generate a counterfeit South Korean military identification card. This fake ID was used in a phishing email that contained links to malware designed to extract data from victims' devices. Targets included journalists, human rights activists and researchers. The incident highlights the growing misuse of AI for cybercrime.

Company involved
Kimsuky
AI system involved
ChatGPT

6 source articles · read the reporting →

WF-USMSK71 Jul 2016

Met Police's Gang Violence Matrix accused of racial discrimination

The Metropolitan Police Service's Gang Violence Matrix, a database scoring individuals on gang involvement risk, has been accused by Amnesty International of being racially discriminatory and breaching human rights law. The matrix, set up after the 2011 London riots, holds data on about 3,800 people, with 78% being black. The Information Commissioner's Office is investigating the database.

Company involved
Metropolitan Police Service
AI system involved
Gang Violence Matrix

9 source articles · read the reporting →

WF-FSUUWV6 Apr 2018

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved
Durham Constabulary
AI system involved
Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

WF-FD3HLB1 Jul 2013

Chicago PD predictive policing program led to man being shot twice

In 2013, the Chicago Police Department's predictive policing algorithm placed Robert McDaniel on a 'heat list' as a potential shooter or shooting victim. Police visited McDaniel and warned him they would be watching him. McDaniel, who had no violent history, was later shot twice. The algorithm's prediction became a self-fulfilling prophecy, according to the article.

Company involved
Chicago Police Department
AI system involved
heat list

10 source articles · read the reporting →

UDR Sued Over Alleged Use of RealPage Algorithm to Set Rents in San Diego

A class action lawsuit alleges that UDR, Inc. used RealPage's YieldStar algorithmic pricing software to set rental rates and occupancy levels for its San Diego properties, in violation of a local ordinance. The suit claims the software relied on nonpublic competitor data, contributing to inflated rents and making housing less affordable. The lawsuit, filed in July 2026, seeks to represent all affected tenants. UDR has previously acknowledged using YieldStar as one tool among others in its decision-making.

Company involved
UDR, Inc.
AI system involved
RealPage YieldStar

1 source article · read the reporting →

Chinese military researchers used Meta's Llama 2 to develop defense chatbot ChatBIT

Chinese military researchers, including two affiliated with the People's Liberation Army, reportedly used Meta's Llama 2 AI model to develop a defense chatbot called ChatBIT. According to Reuters, the chatbot is designed to gather and process intelligence and offer information for operational decision-making. Meta stated that the use was unauthorized and contrary to its acceptable use policy.

Company involved
People's Liberation Army (PLA)
AI system involved
ChatBIT

6 source articles · read the reporting →

WF-SZZI6X15 Sep 2022

Artist receives US copyright registration for AI-assisted comic book

Kris Kashtanova, a New York-based artist, received US copyright registration for their graphic novel Zarya of the Dawn, which features AI-generated artwork created using Midjourney. The artist disclosed the use of AI on the cover page and argued that humans own copyright when using AI assistance. The registration was granted effective September 15, 2022.

Company involved
Midjourney
AI system involved
Midjourney

10 source articles · read the reporting →

Titus Henderson files civil rights lawsuit against COMPAS

Titus Henderson, a prisoner, filed a civil rights lawsuit against COMPAS and other defendants in the U.S. District Court for the Western District of Wisconsin on July 16, 2018. The lawsuit alleges discrimination related to the use of the COMPAS risk assessment tool. The case is ongoing.

AI system involved
COMPAS

6 source articles · read the reporting →

WF-W8NDC11 Jul 2015

New York City's McKinsey-led jail violence program manipulated data, violence increased

New York City paid McKinsey & Company $27.5 million to reduce violence at Rikers Island jail complex. McKinsey designed a predictive algorithm called the Housing Unit Balancer and Restart housing units, but jail officials and McKinsey consultants stacked the units with compliant inmates to artificially lower violence numbers. Violence actually increased by nearly 50% during the project. The city eventually decided to close Rikers.

Company involved
New York City Department of Correction
AI system involved
Housing Unit Balancer (HUB)

10 source articles · read the reporting →

WF-N16FBJ1 Oct 2022

Israeli military uses Smash Hopper turret against Palestinian protesters

The Israeli military deployed Smash Hopper remote-controlled gun turrets in the West Bank. The turrets fire stun grenades, less-than-lethal bullets, and tear gas at Palestinian protesters without warning. The systems were observed at Al-Aroub refugee camp and Hebron in October 2022. The Smash Hopper is produced by Smart Shooter.

Company involved
Israeli military
AI system involved
Smash Hopper

10 source articles · read the reporting →

page 1 of 2Older →