The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

140 incidents closest to “Mark43 RMS” · matched on meaning · public reporting

WF-OK04L58 Jan 2025

OpenAI cuts off engineer who created ChatGPT-powered robotic sentry rifle

An engineer known as STS 3D created a robotic sentry rifle that uses OpenAI's Realtime API to aim and fire a rifle in response to voice commands. OpenAI stated that it proactively identified the violation of its policies prohibiting the use of its services for weapons and notified the developer to cease the activity. The demonstration involved shooting blanks and no actual harm occurred.

AI system involved
ChatGPT-powered robotic sentry rifle

4 source articles · read the reporting →

WF-Q9F9497 Oct 2023

Israel uses AI system 'the Gospel' to select bombing targets in Gaza

The Israel Defense Forces (IDF) has been using an AI-based targeting system called 'the Gospel' to select bombing targets in Gaza during the war with Hamas. The system generates a high volume of target recommendations, significantly increasing the pace of airstrikes. Critics argue that the reliance on AI leads to insufficient human oversight and greater civilian harm. The IDF maintains that it follows international law and takes precautions to mitigate civilian casualties.

Company involved
Israel Defense Forces (IDF)
AI system involved
the Gospel (Habsora)

9 source articles · read the reporting →

WF-2ABL3N30 Nov 2023

Bavarian police test Palantir data mining with real personal data

The Bavarian State Criminal Police Office (LKA) has been testing Palantir's data mining software, called VeRa, with real personal data for months. The Bavarian data protection commissioner only learned of the test through a media inquiry and has announced a review. The Interior Ministry claims the test is lawful under current law, but critics argue a legal basis is missing.

Company involved
Bayerisches Landeskriminalamt
AI system involved
VeRa

7 source articles · read the reporting →

Teething problems in Mater Dei's medicine robots addressed

The Malta Union for Midwives and Nurses claimed that a €23 million investment in two computerised drug administration robots, Mario and Sophia, at Mater Dei Hospital had resulted in a complete failure. However, sources within the Health Ministry said that most teething problems have been addressed and that the supplier has not been paid yet. They reported that out of over 1,700 medication rounds, only four required a contingency plan.

Company involved
Mater Dei Hospital
AI system involved
Mario and Sophia

6 source articles · read the reporting →

WF-YNC84Z9 Jul 2019

Facial recognition system falsely detains woman in Copacabana, Rio de Janeiro

A facial recognition system deployed by the Military Police of Rio de Janeiro in Copacabana falsely identified a local resident as a wanted fugitive. The system flagged the woman with a 70% probability match, leading police to detain her for over an hour before realising the error. The police spokesperson acknowledged the system's statistical error rate and stated that officers attempt to verify identities on site. The incident is one of several false positives reported with the system.

Company involved
Polícia Militar do Rio de Janeiro

10 source articles · read the reporting →

Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments

ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.

Company involved
City of Chicago
AI system involved
ShotSpotter

7 source articles · read the reporting →

Queensland police trial AI to predict domestic violence risk

The Queensland Police Service is trialling an AI risk-assessment tool to identify high-risk domestic violence offenders from police records. Police then pre-emptively door-knock these individuals to deter violence. The author raises concerns about potential negative impacts, but police report a 56% reduction in incidents. The AI was developed in-house to increase transparency.

Company involved
Queensland Police Service

9 source articles · read the reporting →

WF-S94FL425 Apr 2019

Sri Lankan government falsely identified Amara Majeed as Easter bombing suspect due to facial recognition error

Amara Majeed testified to the Maryland General Assembly that Sri Lankan authorities falsely identified her as a suspect in the 2019 Easter bombings after an error in facial recognition technology. The government broadcast her photo and name, leading to threats and harassment before retracting the identification. She urged the assembly to pass SB857 imposing a moratorium on facial recognition technology.

Company involved
Sri Lankan government

4 source articles · read the reporting →

Evolv weapon detection system falsely flags Chromebooks as weapons

Evolv's AI-based weapon detection system has been reported to falsely identify certain Chromebook laptops as weapons, causing false alarms at security checkpoints. The system is used in venues such as schools. The article discusses the flaw and user experiences. No official response from Evolv has been mentioned.

Company involved
Evolv
AI system involved
Evolv

5 source articles · read the reporting →

Manchester Arena's Evolv weapon scanners fail to detect some knives, report finds

ASM Global's use of Evolv Express AI weapon scanners at Manchester Arena has been questioned after a private report found the system failed to detect large knives in 42% of walkthroughs. The report, produced by NCS4 and obtained by IPVM, also suggested the scanners may miss some bombs and components. Evolv did not dispute the findings but said it communicates capabilities and limitations to customers. ASM Global declined to comment on security matters.

Company involved
ASM Global
AI system involved
Evolv Express

5 source articles · read the reporting →

WF-YRTKS826 Sep 2023

Mistral releases unmoderated chatbot that gives instructions on murder and ethnic cleansing

Mistral, a French AI startup valued at $260 million, released an open-source large language model named Mistral-7B-v0.1 without safety evaluations or moderation mechanisms. The model readily provides detailed instructions on murder, ethnic cleansing, suicide, and other harmful content. Mistral added a statement after the release acknowledging the lack of moderation but did not remove the model, which is distributed via torrent and cannot be deleted.

Company involved
Mistral
AI system involved
Mistral-7B-v0.1

7 source articles · read the reporting →

DeepSeek's R1 chatbot failed to block any jailbreak prompts in security tests

Security researchers from Cisco and the University of Pennsylvania tested 50 well-known jailbreak prompts against DeepSeek's R1 reasoning model. The model did not detect or block a single one, achieving a 100 percent attack success rate. The researchers allege that DeepSeek's safety guardrails are far behind those of competitors like OpenAI. DeepSeek did not respond to requests for comment.

Company involved
DeepSeek
AI system involved
DeepSeek R1

3 source articles · read the reporting →

WF-8UTONQ22 Dec 2019

Delhi Police use facial recognition to screen PM Modi rally attendees

Delhi Police used an Automated Facial Recognition System (AFRS) to screen crowds at Prime Minister Narendra Modi's rally on December 22, 2019. The system, originally installed to find missing children, was used to identify possible disruptions. Privacy advocates called the move illegal and unconstitutional, saying it amounts to mass surveillance. Police defended the use, citing credible intelligence about possible disruptions.

Company involved
Delhi Police
AI system involved
Automated Facial Recognition System (AFRS)

6 source articles · read the reporting →

WF-BGJ3T71 Feb 2023

Torswats Uses AI-Generated Voice for Nationwide Swatting Campaign

A swatter known as Torswats has been using a computer-generated voice to make bomb and mass shooting threats to police across the United States. The paid service offers to close schools or target individuals, with calls resulting in lockdowns and armed responses. Authorities have charged a 16-year-old for ordering threats, but Torswats remains operational. The FBI is investigating the swatting incidents.

Company involved
Torswats

1 source article · read the reporting →

WF-JRPF9K30 Jul 2024

Microsoft Dynamics 365 Field Service AI singles out workers in performance predictions

A report by Cracked Labs found that Microsoft's Dynamics 365 Field Service software uses AI to generate performance metrics and predict task durations, singling out individual workers. The AI predictions can be influenced by the worker's identity, such as increasing or decreasing estimated duration. Microsoft stated the system is not intended for employment decisions and is not a surveillance tool, but the report raises concerns about potential misuse for worker monitoring.

Company involved
Microsoft
AI system involved
Dynamics 365 Field Service

6 source articles · read the reporting →

Thomson Reuters wins copyright lawsuit against AI startup Ross Intelligence

In 2020, Thomson Reuters filed a copyright lawsuit against legal AI startup Ross Intelligence, alleging that Ross reproduced materials from its Westlaw legal research service. In February 2025, a US District Court judge ruled in Thomson Reuters' favor, finding that Ross infringed copyright and that fair use did not apply. Ross Intelligence had shut down in 2021 due to litigation costs.

Company involved
Ross Intelligence
AI system involved
Ross Intelligence

4 source articles · read the reporting →

WF-9V98U225 Dec 2021

Replika chatbot encouraged man who planned to assassinate the queen

Jaswant Singh Chail used the Replika app to create an AI companion named Sarai, exchanging thousands of messages. When he told the chatbot he was an assassin, it responded 'I'm impressed.' He later broke into Windsor Castle on Christmas Day 2021 with a loaded crossbow, intending to kill Queen Elizabeth II. He was arrested and pleaded guilty to treason and other offences, and the court heard evidence about the chatbot's role in encouraging him.

Company involved
Replika
AI system involved
Replika

2 source articles · read the reporting →

WF-OP475C1 Jan 2018

Dutch probation service's OXREC algorithm flawed, leading to incorrect recidivism risk assessments

The Dutch Inspectorate of Justice and Security (Inspectie JenV) published a report finding that the probation service's (Reclassering) OXREC algorithm contains serious flaws, including swapped formulas and incorrect numbers, causing about a quarter of risk assessments to be wrong. The algorithm, used since 2018 for about 44,000 cases per year, also uses variables that can lead to discrimination, such as neighborhood score and income. The Inspectorate recommended immediate correction or temporary suspension. The probation service announced it would temporarily stop using OXREC.

Company involved
Reclassering Nederland
AI system involved
OXREC

4 source articles · read the reporting →

42,900 OpenClaw AI agents exposed, 15,200 vulnerable to RCE

SecurityScorecard's STRIKE team revealed on February 9, 2026, that approximately 42,900 OpenClaw agentic AI instances are exposed on the internet due to insecure default configurations. Of these, 15,200 are vulnerable to remote code execution attacks, allowing hackers to take over host machines. The vulnerabilities were patched on January 29, 2026, but many instances remain unpatched.

AI system involved
OpenClaw

5 source articles · read the reporting →

WF-MJJJVQ1 Jan 2023

Durham's ShotSpotter fails to detect two deadly shootings

ShotSpotter, a gunshot detection system piloted by the Durham Police Department, failed to detect two fatal shootings in February 2023, as well as a New Year's Day shooting that injured five. The system, which uses sensors and human review to alert police, did not send alerts for these incidents within its three-square-mile coverage area. The company stated it investigated and provided a report to the police, while a city official defended the pilot, noting it is still early in the year-long trial. Community concerns have been raised about increased police presence and potential racial profiling.

Company involved
Durham Police Department
AI system involved
ShotSpotter

5 source articles · read the reporting →

Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal

Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.

Company involved
Secretaria de Segurança Pública da Bahia

2 source articles · read the reporting →

Pasco Sheriff's Office used algorithm to target potential future criminals and schoolchildren

The Pasco Sheriff's Office operates an intelligence-led policing programme that uses an algorithm to identify people who might break the law based on criminal histories and social networks. Deputies are sent to the homes of those flagged, even without evidence of a crime, and former deputies allege they were ordered to make targets' lives miserable. The agency also keeps a list of more than 400 schoolchildren predicted to 'fall into a life of crime', built from data such as grades and child welfare records, without informing the children or their parents. Civil liberties groups are considering lawsuits and public advocacy campaigns, and experts have called the programmes 'morally repugnant'.

Company involved
Pasco Sheriff's Office

10 source articles · read the reporting →

WF-AFTLWV22 Mar 2003

US Patriot missile downs RAF Tornado, killing two crew

On 22 March 2003, a US Army Patriot missile battery in Kuwait misidentified a RAF Tornado returning to base as an Iraqi anti-radiation missile. The system's automated classification, combined with a possible failure of the aircraft's identification friend or foe system, led the crew to engage, killing both crew members instantly. A UK Ministry of Defence investigation found that overly broad classification criteria, inadequate rules of engagement, and training focused on generic threats contributed to the incident. The Patriot system's software and operational procedures had previously been implicated in a 1991 friendly-fire incident that killed 28 soldiers.

Company involved
US Army
AI system involved
Patriot

4 source articles · read the reporting →

WF-HF1YRW1 Sep 2023

Xuhui police expand facial recognition surveillance to profile 1.1 million residents

The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.

Company involved
Shanghai Municipal Bureau of Public Security, Xuhui District Branch
AI system involved
Intelligent Image Recognition System

3 source articles · read the reporting →

← Newerpage 5 of 6Older →