The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

151 incidents matching “Assist” · public reporting

WF-5LUPLZ3 Oct 2019

Krungthai Bank's Pao Tang app facial recognition fails, causing queues at branches

Users of the Thai government's Chim Chop Chai stimulus program reported being unable to verify their identity through the Pao Tang app's facial recognition system. Many had to queue at Krungthai Bank branches, with some using shoes to hold their place, to get assistance. The bank provided tips for successful scanning and advised those with persistent issues to visit a branch. The system was not down, but mismatches between appearance and ID photos caused failures.

Company involved
Krungthai Bank
AI system involved
Pao Tang

3 source articles · read the reporting →

WF-2NBMDB1 Jan 2020

NYPD Used Robot Dogs for Surveillance in NYC, Terminated After Backlash

The New York Police Department (NYPD) used Digidog, a robotic dog from Boston Dynamics, to assist in crime scene assessments and emergencies in low-income communities of color in New York City from 2020 to April 2021. Activists and U.S. Rep. Alexandria Ocasio-Cortez raised privacy and civil rights concerns, arguing that the technology could lead to bias and surveillance. Following public backlash, the NYPD terminated its contract and returned the robot dog to Boston Dynamics.

Company involved
New York Police Department
AI system involved
Digidog

10 source articles · read the reporting →

WF-RZAFQ69 May 2026

Waymo rider trapped in robotaxi during vandalism attack in San Francisco

In May 2026, Sherman Watson was riding in a Waymo robotaxi in San Francisco when two men attacked the vehicle, smashing the windshield. The car stopped and remained stationary, trapping Watson inside for about 10 minutes while he feared for his life. Waymo's remote assistant called police but could not move the car. Watson later sought therapy and requested video footage from Waymo, which the company has not provided, citing the need for a police search warrant.

Company involved
Waymo
AI system involved
Waymo robotaxi

1 source article · read the reporting →

WF-VEBWVB25 Sep 2024

Russian trolls use AI deepfakes to smear Kamala Harris with rhino poaching claim

Russian influence group Storm-1516 posted an AI-generated deepfake video falsely accusing US Vice President Kamala Harris of killing an endangered rhinoceros in Zambia. The video, released on 25 September 2024, was amplified by affiliated websites and channels. Microsoft's Threat Analysis Center reported that Russia, Iran, and China are ramping up AI-assisted disinformation efforts ahead of the US election. The incident is part of a broader campaign targeting Harris and other Democratic candidates with fabricated scandals.

Company involved
Storm-1516

10 source articles · read the reporting →

WF-J5NF5A1 Jan 2020

UAE Company Loses $35 Million in Deepfake Audio Scam

Fraudsters used forged emails and deepfake audio to impersonate a company director, convincing a branch manager at a UAE company to transfer $35 million as part of a fake acquisition. The manager believed he was following instructions from the director and a US-based lawyer. The incident, which occurred in January 2020, led to a US federal court request for assistance in tracing the stolen funds. The case highlights the growing threat of deepfake technology in corporate fraud.

6 source articles · read the reporting →

Boosie Badazz deceived by AI deepfake of Elon Musk promoting fake diabetes cure

Rapper Boosie Badazz was deceived by an AI-generated deepfake video that falsely depicted Elon Musk endorsing a 17-hour diabetes cure. The video, which spread on social media, was a scam designed to sell unverified health products. Boosie Badazz shared his assistant's phone number in an attempt to obtain the cure, highlighting the dangers of AI-generated misinformation. The deepfake was debunked by media outlets and AI verification tools, but no legal or regulatory actions were reported.

1 source article · read the reporting →

US State Department to use AI to revoke student visas over pro-Hamas posts

The US State Department is reported to be using AI-assisted reviews of tens of thousands of foreign students' social media accounts, with a view to revoking visas of those deemed 'pro-Hamas'. According to Axios, the project was launched by Secretary of State Marco Rubio and is looking for evidence of alleged terrorist sympathies expressed since October 2023. Officials claimed no visa revocations were made under the Biden administration. No individual revocations have yet been reported.

Company involved
US State Department

5 source articles · read the reporting →

WF-UQ0Z2U1 Jan 2020

Domino's sued over AI phone system collecting voiceprints without consent

A class action lawsuit alleges that Domino's Pizza Inc. collected voiceprints of Illinois customers using an AI-assisted phone ordering system without their consent, violating the state's biometric privacy law. The plaintiffs, Zachery Young, Jonathan Neumann, and Odilon Garcia, claim the technology, provided by ConverseNow Technologies Inc., gathered sensitive voice data from thousands of consumers since 2020. The complaint was filed in the US District Court for the Northern District of Illinois. The case is pending.

Company involved
Domino's Pizza Inc.
AI system involved
ConverseNow AI phone ordering system

5 source articles · read the reporting →

WF-QVH2VA10 Dec 2023

Investing.com uses AI to copy competitors' articles without credit

Investing.com, a financial news site owned by Joffre Capital, is accused of using AI to generate stories that closely resemble articles published by competitors such as CryptoNewsLand, The Motley Fool, and FXStreet. The AI-generated pieces often cite the same statistics and sources as the originals but do not credit them. Competitors like FXStreet have expressed concern that this practice threatens original journalism. Investing.com disclosed AI assistance in its stories but did not respond to requests for comment.

Company involved
Investing.com
AI system involved
Unnamed AI content generation system

8 source articles · read the reporting →

WF-XPFO9119 Aug 2019

Engineer.ai accused of exaggerating AI capabilities and using human engineers

Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.

Company involved
Engineer.ai

6 source articles · read the reporting →

WF-TPM63A8 Apr 2025

Johor teen arrested for AI deepfake porn of schoolmates

A 16-year-old boy in Johor Bahru, Malaysia, was arrested for allegedly using AI to create pornographic images of his schoolmates and alumni, which he then sold on social media. Police received eight reports and seized a phone used to edit and upload the images. The case is being investigated under obscenity and communications laws, and the regulator MCMC is assisting. Victims include current students as young as 14, and the images were circulated in groups named after the school.

1 source article · read the reporting →

Tesla Autopilot involved in 13 fatal crashes, US regulator finds

The US National Highway Traffic Safety Administration (NHTSA) found that Tesla's Autopilot driver-assistance system was involved in at least 13 fatal crashes. The regulator stated that Tesla's weak driver engagement system and permissive operating capabilities created a critical safety gap, and that the name 'Autopilot' may mislead drivers about its capabilities. Tesla issued a recall for 2.03 million vehicles to improve driver monitoring, but the NHTSA opened a second investigation to assess whether the recall adequately addressed the safety concerns.

Company involved
Tesla
AI system involved
Autopilot

2 source articles · read the reporting →

Perth hospital group bans ChatGPT after doctor used it for a patient discharge summary

South Metropolitan Health Service, which runs five hospitals in Perth, ordered staff to stop using ChatGPT for work involving patient information after an email said some staff had used the AI chatbot to write medical notes. The service later clarified that only one doctor had used the tool to generate a patient discharge summary and that no confidential patient information had been breached. The Australian Medical Association has called for national regulations to ensure a human is involved in AI-assisted health decisions.

Company involved
South Metropolitan Health Service
AI system involved
ChatGPT

6 source articles · read the reporting →

Class action claims Navy Federal allows AI co. to monitor, record calls - Top Class Actions

The system intercepted, recorded, and analyzed customer service calls without consent, affecting the privacy of callers.

Company involved
Navy Federal Credit Union
AI system involved
Verint Real-Time Agent Assist

1 source article · read the reporting →

WF-O8NHQF18 May 2021

Google's dermatology app underrepresents dark skin tones in training data

Google unveiled a dermatology app that uses deep learning to recognise skin conditions. However, the training data included only 3.5% images from patients with darker skin types, which may lead to inaccurate diagnoses for these groups. Dermatologists have expressed concern that the app could cause false positives or missed diagnoses, and Google has acknowledged the issue while saying it will continue to refine the technology.

Company involved
Google
AI system involved
AI-powered dermatology assist tool

9 source articles · read the reporting →

Presto Automation uses off-site human agents to double-check AI drive-thru orders

Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.

Company involved
Presto Automation Inc.

8 source articles · read the reporting →

Tesla Employee Dies in Full Self-Driving Crash in Colorado Mountains

Hans von Ohain, a Tesla recruiter, died when his Model 3 crashed into a tree and caught fire while using Tesla's Full Self-Driving feature on a mountain road in Colorado. His widow, Nora Bass, criticised Tesla for lack of response, saying they were treated like 'guinea pigs'. Investigators noted that Ohain's blood alcohol was over three times the legal limit, but the crash did not show typical signs of drunk driving, suggesting the driver-assistance feature was active. Tesla has not commented on the incident.

Company involved
Tesla
AI system involved
Full Self-Driving

10 source articles · read the reporting →

WF-RU8B2V17 Apr 2021

Two Men Killed in Tesla Crash with No Driver at Wheel

On April 17, 2021, a 2019 Tesla Model S crashed into a tree and caught fire in Spring, Texas, killing the two occupants. Authorities believe no one was behind the wheel at the time, and witnesses said the men were discussing Autopilot's self-driving capabilities before the drive. Tesla CEO Elon Musk stated that data logs indicate Autopilot was not enabled, but investigations by NHTSA and NTSB are ongoing. The incident highlights the gap between Tesla's marketing of its driver-assistance features and their actual capabilities.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

WF-333WY81 May 2025

Philip Morris accused of using AI to rig EU tobacco consultation responses

Dutch broadcasters Pointer and NOS allege that Philip Morris International used an AI-powered platform, 'Your Voice, Your Choice', to generate responses to the European Commission's public consultation on tobacco legislation. The platform offered pre-defined responses and AI assistance, leading to an estimated 30 per cent of all responses being AI-generated. Philip Morris denies wrongdoing, stating that users retained full control and that anti-tobacco lobbyists are attempting to discredit legitimate participation. The incident raises concerns about the integrity of EU democratic processes.

Company involved
Philip Morris International
AI system involved
Your Voice, Your Choice

4 source articles · read the reporting →

WF-51NEWF17 Feb 2024

UIUC researchers weaponize GPT-4 to autonomously hack websites

Researchers at the University of Illinois Urbana-Champaign demonstrated that LLM-powered agents, particularly OpenAI's GPT-4, can autonomously hack vulnerable websites. In sandboxed tests, GPT-4 achieved a 73.3% success rate across five attempts on 15 vulnerabilities, while open-source models failed. The researchers used the OpenAI Assistants API, LangChain, and Playwright to enable the agents to interact with websites. The study highlights the potential for AI agents to be used in cyberattacks, with cost estimates suggesting they could be cheaper than human penetration testers.

Company involved
University of Illinois Urbana-Champaign
AI system involved
GPT-4

4 source articles · read the reporting →

WF-CHRBJK10 Oct 2019

Knightscope RoboCop ignores woman’s emergency call in California park

During a fight in a Salt Lake Park parking lot in Huntington Park, California, a bystander pressed the emergency button on a Knightscope RoboCop security robot. The robot repeatedly told her to ‘step out of the way’ instead of summoning help. The woman then tried to get the robot’s camera to recognise the situation, but it still did not assist, and a companion had to dial 911. The police chief stated the robots are on a trial basis and not yet linked to the police department.

Company involved
Knightscope
AI system involved
RoboCop

5 source articles · read the reporting →

AWS averts AI supply chain disaster after malicious code injected into Amazon Q Developer

AWS discovered that a threat actor had inserted malicious code into the open-source repository of its AI coding assistant, Amazon Q Developer, via a misconfigured GitHub token. The malicious code was distributed with the extension but failed to execute due to a syntax error, averting a potentially catastrophic supply chain attack. AWS promptly revoked credentials, removed the code, and released a patched version, while also enhancing security measures for its build service. The incident highlights the risks of AI agents with broad access and the importance of securing development pipelines.

Company involved
Amazon Web Services
AI system involved
Amazon Q Developer

4 source articles · read the reporting →

Arizona court sanctions litigant for AI-hallucinated legal citations

Jeffrey Kotchka, representing himself in a probate appeal, used generative AI to draft his legal brief and submitted it without verifying the citations. The Arizona Court of Appeals found that six of eight citations were deficient, including two that referred to non-existent cases. The court sanctioned Kotchka by ordering him to pay the opposing party's attorney's fees incurred in addressing the fake citations, ruling that citing hallucinated cases is sanctionable regardless of intent. The court acknowledged AI's potential to assist self-represented litigants but emphasised the duty to verify all citations.

1 source article · read the reporting →

Google and X AI chatbots falsely claim Iran war photo is fake

In March 2026, a real photograph of graves for victims of an airstrike on a school in Minab, Iran, went viral. When users asked Google's Gemini and X's Grok AI assistants to verify the image, both chatbots incorrectly claimed it was from other events, such as the 2023 Turkey earthquake or COVID burials in Indonesia. The false responses, presented with confidence and fabricated sources, contributed to a wave of AI-generated misinformation surrounding the Iran war. Fact-checkers say such errors waste investigative time and risk causing real atrocities to be denied.

Company involved
Google and X
AI system involved
Gemini and Grok

1 source article · read the reporting →

← Newerpage 6 of 7Older →