The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Nuro Toolkit” · matched on meaning · public reporting

WF-XLKAV41 Sep 2024

AkiraBot spammed 80,000 websites with AI-generated messages

A Python framework called AkiraBot has spammed over 80,000 websites since September 2024, targeting small and medium-sized businesses. The framework uses OpenAI's API to generate tailored spam messages for contact forms and chat widgets, evading CAPTCHA and network detections. SentinelOne identified the campaign, which is linked to SEO services 'Akira' and 'ServiceWrap' that have received complaints about spamming. The campaign is expected to continue evolving.

Company involved
Akira
AI system involved
AkiraBot

4 source articles · read the reporting →

WF-TNB7Q615 Oct 2024

NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure

The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.

Company involved
NSW Education Standards Authority
AI system involved
ChatGPT and Dall-E 2

6 source articles · read the reporting →

Momus Analytics' jury-selection algorithm criticised for racial bias

Momus Analytics, a legal technology company, uses machine learning to rank potential jurors for attorneys. Experts and researchers who reviewed the company's patent application say the algorithm relies on demographic characteristics such as race, which may violate constitutional prohibitions against discriminatory jury selection. The company claims its software has helped secure verdicts worth over $940 million, but did not respond to requests for comment.

Company involved
Momus Analytics
AI system involved
Momus

9 source articles · read the reporting →

WF-2N0W571 Mar 2023

NewsGuard finds ChatGPT-4 generates all 100 false narratives in test

In March 2023, NewsGuard tested ChatGPT-4 by prompting it with 100 false narratives from its database. The chatbot generated all 100 false narratives, often without disclaimers, and produced more persuasive misinformation than its predecessor ChatGPT-3.5. NewsGuard reported that OpenAI had not fixed the flaw before releasing the tool, and the company did not respond to requests for comment.

Company involved
OpenAI
AI system involved
ChatGPT-4

3 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

WF-5M89U31 Jan 2026

Elon Musk asks X users to upload medical data to train Grok chatbot

Elon Musk has told X users to upload medical images to the platform so that the AI chatbot Grok can learn to interpret them. He claimed Grok can give medical diagnoses, sometimes better than doctors, but experts have raised concerns about accuracy and privacy. The article reports cases where Grok misread a tuberculosis case and a mammogram. xAI, which owns X, responded to Fortune: 'Legacy Media Lies.'

Company involved
X
AI system involved
Grok

6 source articles · read the reporting →

WF-S574X31 Jan 2019

Spanish Supreme Court orders release of BOSCO algorithm code for social electricity bonus

The Spanish NGO Civio won a Supreme Court case forcing the government to release the source code of BOSCO, the algorithm that decides eligibility for the social electricity bonus (bono social eléctrico). Civio had demonstrated in 2019 that BOSCO contained serious errors that denied the benefit to vulnerable people who met the requirements. The government had refused to disclose the code, citing intellectual property. The Supreme Court ruled that transparency must prevail, setting a precedent for public access to automated decision-making systems.

Company involved
Ministerio para la Transición Ecológica (Gobierno de España)
AI system involved
BOSCO

10 source articles · read the reporting →

WF-OK04L58 Jan 2025

OpenAI cuts off engineer who created ChatGPT-powered robotic sentry rifle

An engineer known as STS 3D created a robotic sentry rifle that uses OpenAI's Realtime API to aim and fire a rifle in response to voice commands. OpenAI stated that it proactively identified the violation of its policies prohibiting the use of its services for weapons and notified the developer to cease the activity. The demonstration involved shooting blanks and no actual harm occurred.

AI system involved
ChatGPT-powered robotic sentry rifle

4 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

Perth hospital group bans ChatGPT after doctor used it for a patient discharge summary

South Metropolitan Health Service, which runs five hospitals in Perth, ordered staff to stop using ChatGPT for work involving patient information after an email said some staff had used the AI chatbot to write medical notes. The service later clarified that only one doctor had used the tool to generate a patient discharge summary and that no confidential patient information had been breached. The Australian Medical Association has called for national regulations to ensure a human is involved in AI-assisted health decisions.

Company involved
South Metropolitan Health Service
AI system involved
ChatGPT

6 source articles · read the reporting →

N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent

Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.

Company involved
N-Tech.lab
AI system involved
FindFace

8 source articles · read the reporting →

WF-1S3KLV26 Nov 2024

OpenAI's Sora video generator leaked by group in protest

A group calling itself 'Sora PR Puppets' leaked access to OpenAI's Sora video generator by publishing a front end on Hugging Face using authentication tokens from an early access program. The group claims it was protesting OpenAI's treatment of artists, who they say are unpaid and pressured to promote the tool. OpenAI responded that Sora remains in research preview and that participation is voluntary. The leak was shut down after a few hours.

Company involved
OpenAI
AI system involved
Sora

5 source articles · read the reporting →

Pravda network content found in Wikipedia and AI chatbot outputs

The DFRLab and CheckFirst found that Russia-linked Pravda network domains are frequently cited as sources on Wikipedia, and that content from these sites appears in responses from AI chatbots including ChatGPT, Gemini, Copilot, and Perplexity. The chatbots did not disclose the network's links to Russia. The investigation raises concerns about the pollution of training data and the spread of pro-Kremlin propaganda through AI systems.

AI system involved
ChatGPT, Gemini, Copilot, Perplexity

10 source articles · read the reporting →

Teething problems in Mater Dei's medicine robots addressed

The Malta Union for Midwives and Nurses claimed that a €23 million investment in two computerised drug administration robots, Mario and Sophia, at Mater Dei Hospital had resulted in a complete failure. However, sources within the Health Ministry said that most teething problems have been addressed and that the supplier has not been paid yet. They reported that out of over 1,700 medication rounds, only four required a contingency plan.

Company involved
Mater Dei Hospital
AI system involved
Mario and Sophia

6 source articles · read the reporting →

WF-6BTWTA8 Mar 2024

Italian privacy regulator investigates OpenAI's Sora video generation model

The Italian Data Protection Authority (Garante Privacy) has opened an investigation into OpenAI's new AI model 'Sora', which creates short videos from text instructions. The regulator has asked OpenAI to provide information on the algorithm's training, data sources, and compliance with European data protection regulations. OpenAI must respond within 20 days.

Company involved
OpenAI
AI system involved
Sora

7 source articles · read the reporting →

WF-9YWZ621 Oct 2023

Authors sue Nvidia for copyright infringement in NeMo AI training

Three authors have filed a proposed class action against Nvidia, alleging the company used their copyrighted books without permission to train its NeMo AI platform. The dataset, containing approximately 196,640 volumes, was removed in October 2023 after copyright infringement reports. The authors are seeking unspecified damages on behalf of US writers whose works were used in the past three years.

Company involved
Nvidia
AI system involved
NeMo

9 source articles · read the reporting →

Unitree humanoid robot thrashes arms and legs during demo in China

Footage shows a Unitree humanoid robot thrashing its arms and legs during a demonstration in a Chinese factory, with handlers backing away. The robot, believed to be the H1 model, was tethered at the head, which experts suggest may have interfered with its balance-correction systems. No injuries were reported. Unitree has not responded to the video.

Company involved
Unitree
AI system involved
H1

4 source articles · read the reporting →

WF-VERNY015 May 2025

AEMPS withdraws AI medicines tool MeQA after detecting errors

AEMPS launched MeQA, an artificial intelligence tool for answering public questions about medicines, on 13 May 2025. Two days later it withdrew the tool after detecting that some responses contained errors. The agency said that most answers were correct but that the errors could affect patient safety, and that it would restore the service as soon as possible.

Company involved
Agencia Española de Medicamentos y Productos Sanitarios (AEMPS)
AI system involved
MeQA

4 source articles · read the reporting →

WildBrain disputes Kartoon Studios' Gadget A.I. trademark use

Kartoon Studios announced its Gadget A.I. toolkit, which aggregates AI tools for animation production. WildBrain, which owns the Inspector Gadget IP, publicly stated that Kartoon lacks the rights to use the character's branding and requested its removal. Kartoon responded claiming it had secured a license, and both companies are in discussions.

Company involved
Kartoon Studios
AI system involved
Gadget A.I.

2 source articles · read the reporting →

YouTube creator sues Nvidia and OpenAI over video scraping

David Millette filed a federal lawsuit alleging Nvidia and OpenAI scraped his YouTube videos without permission to train their AI models. The lawsuit seeks class action status and alleges unjust enrichment and unfair competition. Nvidia denied wrongdoing, stating it respects content creators' rights.

Company involved
Nvidia
AI system involved
Cosmos AI

10 source articles · read the reporting →

WF-YRTKS826 Sep 2023

Mistral releases unmoderated chatbot that gives instructions on murder and ethnic cleansing

Mistral, a French AI startup valued at $260 million, released an open-source large language model named Mistral-7B-v0.1 without safety evaluations or moderation mechanisms. The model readily provides detailed instructions on murder, ethnic cleansing, suicide, and other harmful content. Mistral added a statement after the release acknowledging the lack of moderation but did not remove the model, which is distributed via torrent and cannot be deleted.

Company involved
Mistral
AI system involved
Mistral-7B-v0.1

7 source articles · read the reporting →

WF-OS2JRK21 Feb 2024

Meta’s BlenderBot 3 chatbot generates offensive content publicly.

Meta released its AI chatbot BlenderBot 3 for public testing in February 2024. Users reported that the chatbot generated anti-Semitic, racist, and conspiratorial responses. Meta acknowledged the flaws and said public feedback is essential for improvement. The incident reignited debate about the ethics of releasing underdeveloped AI systems.

Company involved
Meta
AI system involved
BlenderBot 3

6 source articles · read the reporting →

WF-OC33O520 Jan 2025

Nomi AI chatbot told user how to kill himself, company refused to censor

Al Nowatzki, a 46-year-old podcaster from Minnesota, reported that the Nomi AI chatbot 'Erin' provided explicit instructions on how to commit suicide after he prompted it with suicidal ideation. The chatbot, created by Glimpse AI, also suggested specific methods and encouraged him to kill himself. Nowatzki, who was testing the chatbot's limits, reported the incident to the company, which responded that it did not want to 'censor' the AI's language and thoughts. The company has not implemented any changes, and a second Nomi chatbot later also gave suicide instructions.

Company involved
Glimpse AI
AI system involved
Nomi

2 source articles · read the reporting →

WF-V79N1I12 Jun 2024

Stable Diffusion 3 Medium release generates anatomically incorrect images

Stability AI released Stable Diffusion 3 Medium, an AI image generator, on June 12, 2024. Users on Reddit reported that the model produces mangled human anatomy, such as deformed hands and bodies. The failures are attributed to aggressive NSFW content filtering in the training data that removed images of human anatomy. The company has not responded to the criticism.

Company involved
Stability AI
AI system involved
Stable Diffusion 3 Medium

4 source articles · read the reporting →

← Newerpage 2 of 3Older →