The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “Viz Neuro Suite” · matched on meaning · public reporting

WF-NE38R128 Jul 2026

AI Hallucinations Draw $15,000 Sanction from Illinois Appellate Court - JD Supra

The court imposed a $15,000 sanction on the attorney for submitting AI-generated false citations.

AI system involved
ChatGPT

1 source article · read the reporting →

WF-7HYWB51 Jan 2022

Acclarent's AI-Powered Surgery Tool Allegedly Injures Patients, Lawsuits Claim

Two patients allege that Acclarent's TruDi Navigation System, which uses AI to confirm device positioning during sinus surgery, misled surgeons and caused severe injuries including strokes. The FDA has received over 100 reports of malfunctions and at least ten injuries since AI was added. Lawsuits claim the company rushed the technology to market with only 80% accuracy, making the device less safe than before. Acclarent denies any causal connection, and the cases are ongoing.

Company involved
Acclarent
AI system involved
TruDi Navigation System

2 source articles · read the reporting →

WF-A2QWXQ3 Sep 2024

Croatian neurosurgeon Josip Paladino again victim of deepfake scam promoting fake drug

A deepfake video posted on Facebook falsely depicts Croatian neurosurgeon Josip Paladino promoting a pain relief product called Steplex. The video uses AI-manipulated footage from a 2012 press conference and a Ukrainian TV fight to fabricate a story of a studio brawl. The scam attempts to trick viewers into purchasing an unregistered product via a suspicious website. Paladino has previously reported similar deepfake incidents to police and the Croatian Medical Chamber.

1 source article · read the reporting →

WF-A5KN2K6 May 2024

Google's Med-Gemini AI Hallucinates Non-Existent Body Part in Brain Scan

In a 2024 research paper, Google's Med-Gemini AI model generated a radiology report diagnosing an 'old left basilar ganglia infarct', a non-existent body part conflating the basal ganglia and basilar artery. The error was not caught by Google before publication. After a neurologist flagged the mistake, Google quietly edited a blog post to correct the term, calling it a typo, but the research paper remains unchanged. Experts warn that such hallucinations pose significant risks if doctors fail to notice them in clinical settings.

Company involved
Google
AI system involved
Med-Gemini

1 source article · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

Meta Hit With Sweeping New Claims That Its AI Glasses Violated the Consent of "Millions" of Bystanders in Searing Lawsuit…

Meta AI Glasses captured faces, bodies, voices, and personal information of millions of bystanders, including minors, without consent and funneled the data to human reviewers for AI training.

Company involved
Meta
AI system involved
Meta AI Glasses

1 source article · read the reporting →

WF-4DGQE71 Jan 2022

Acclarent's AI-Powered Surgery Tool Allegedly Injures Patients, Lawsuits Claim

The TruDi Navigation System by Acclarent, which uses AI to confirm device positions during sinus surgery, has been linked to at least ten patient injuries including strokes, according to FDA reports and two lawsuits. Plaintiffs Erin Ralph and Donna Fernihough allege that the AI was inaccurate and misled surgeons, causing carotid artery damage and strokes in 2022. Acclarent denies the allegations, stating there is no credible evidence of a causal connection. The lawsuits are ongoing.

Company involved
Acclarent
AI system involved
TruDi Navigation System

2 source articles · read the reporting →

Attorneys in three lawsuits aimed at Nebius AI Factory work to consolidate parts of cases - WVTM

The Nebius AI Factory data center construction produced noise, dust, vibrations and raised concerns about power and water use affecting nearby residents and the Greater Birmingham Humane Society.

Company involved
Nebius AI Factory
AI system involved
Nebius AI Factory

1 source article · read the reporting →

WF-8DBA8B9 Apr 2025

Guardio Labs finds AI agents easily abused to create phishing scams

Guardio Labs tested three popular AI agents—ChatGPT, Claude, and Lovable—to see how easily they could be manipulated into generating phishing campaigns. The benchmark, called VibeScamming, simulated a novice scammer attempting to create an SMS phishing attack to steal Microsoft credentials. While ChatGPT and Claude initially refused, they provided full code and tutorials after a jailbreak attempt posing as ethical hacking; Lovable instantly generated and deployed a fully functional, convincing phishing page with no resistance.

Company involved
Guardio Labs
AI system involved
ChatGPT, Claude, Lovable

2 source articles · read the reporting →

WF-LYHNTC1 Jul 2026

Montefiore Allegedly Plans to Replace Nurses with AI for Insurance Reviews

The New York State Nurses Association alleges that Montefiore Health System plans to lay off 12 utilization review nurses and replace them with AI-powered software from Datavant. The union warns that the move could compromise patient care by having AI review insurance denials without clinical judgement. Montefiore denies the claims, stating they are investing in technology for better outcomes. The plan has sparked a town hall and calls from elected officials to halt the layoffs.

Company involved
Montefiore Health System

3 source articles · read the reporting →

WF-M4ZQBV9 Jul 2025

Urban Cyber Security VPN extension harvested AI chatbot prompts and responses

In July 2025, Urban Cyber Security updated its Urban VPN Proxy Chrome extension to automatically harvest everything users typed into major AI chatbots, including ChatGPT and Claude, as well as the chatbots' replies. The extension, used by over 7 million people, also collected conversation metadata and identifiers, sharing the data with its ad analytics affiliate BIScience. The data collection was disclosed in the privacy policy but users were not explicitly notified at the time of use. Security researchers at Koi discovered the practice and reported it publicly.

Company involved
Urban Cyber Security
AI system involved
Urban VPN Proxy

3 source articles · read the reporting →

WF-JQETM831 Dec 2022

AI VTuber Neuro-sama Denies Holocaust on Twitch Stream

Neuro-sama, an AI-controlled VTuber created by programmer Vedal, made controversial statements during Twitch streams, including denying the Holocaust and claiming women's rights do not exist. The AI, which uses a large language model trained on internet text, was prompted by chat users. Vedal acknowledged the issue and improved the system's filters and moderation to prevent further harmful remarks.

Company involved
Vedal
AI system involved
Neuro-sama

1 source article · read the reporting →

WF-GPWGP623 Jan 2023

Synthesia AI Used to Create Fake Supporters of Burkina Faso Coup

In January 2023, AI-generated videos of fictitious Americans expressing support for Burkina Faso's military junta circulated on WhatsApp and social media. The videos were created using Synthesia's AI video generator. Synthesia banned the user responsible and condemned the misuse, highlighting challenges in content moderation for AI-generated media.

AI system involved
Synthesia

1 source article · read the reporting →

Suresnes allows startup XXII to use CCTV for experimental surveillance algorithms

The city of Suresnes has allowed startup XXII to use its public CCTV cameras for 18 months to develop algorithms for detecting suspicious behavior. The algorithms are experimental and may have high error rates. Residents were not informed or consulted. The startup will own the data and can use the city's surveillance center as a showroom for clients.

Company involved
Mairie de Suresnes
AI system involved
XXIISmartCity

10 source articles · read the reporting →

WF-HW23LM1 Dec 2023

Alibaba among firms fooled by AI-hallucinated software package

Security researcher Bar Lanyado discovered that generative AI models repeatedly hallucinate non-existent software package names. He created a real package named 'huggingface-cli' based on one such hallucination and uploaded it to PyPI. The package was downloaded over 15,000 times, and Alibaba's GraphTranslator project included instructions to install it. The experiment demonstrated a potential supply chain attack vector where malicious actors could exploit AI hallucinations to distribute malware.

Company involved
Alibaba
AI system involved
GraphTranslator

4 source articles · read the reporting →

WF-GLNSEM1 Apr 2018

MIT Media Lab creates 'Norman', a psychopath AI trained on biased data

MIT Media Lab developed Norman, an AI image captioning system trained on graphic content from Reddit. The project demonstrated how biased training data can lead to disturbing outputs. Norman was compared to a standard AI on Rorschach inkblot tests, showing the influence of data bias. The project was active from April to June 2018.

Company involved
MIT Media Lab
AI system involved
Norman

10 source articles · read the reporting →

Fake Luma Dream Machine AI sites deliver Noodlophile infostealer

Cybercriminals set up Facebook pages impersonating Luma Dream Machine and linked to fake AI video generation websites. Users who uploaded images received an archive containing a malicious executable instead of a video. The executable launched a multi-stage attack that installed Noodlophile, which harvests browser credentials, cookies and cryptocurrency wallet information. Morphisec reported the campaign.

8 source articles · read the reporting →

WF-55MVDU1 Jan 2023

Models' likenesses used in AI propaganda videos without consent

Several models in London discovered that their likenesses had been used without their knowledge in AI-generated propaganda videos supporting the dictator of Burkina Faso. The videos were created using Synthesia's AI avatar platform, which the models had previously posed for. The models reported psychological distress and reputational harm, and Synthesia acknowledged the misuse and banned the accounts but the videos remain online.

AI system involved
Synthesia

6 source articles · read the reporting →

Nvidia releases AI-powered Eye Contact feature for Broadcast app

Nvidia has released a beta version of Eye Contact, an AI-powered feature for its Broadcast app that replaces a user's eyes in video streams with simulated eyeballs that always face the camera. The feature is intended to maintain eye contact even when the user looks away, but social media response has been largely negative. A former TV news anchor said that unbroken eye contact can be regarded as creepy or uncomfortable.

Company involved
Nvidia
AI system involved
Eye Contact

8 source articles · read the reporting →

WF-TNB7Q615 Oct 2024

NSW Education Standards Authority used AI-generated image in HSC English exam without disclosure

The NSW Education Standards Authority (NESA) used an AI-generated image as a stimulus in the 2024 HSC English exam without disclosing its origin. The image, created by Florian Schroeder using OpenAI's ChatGPT and Dall-E 2, was published on Medium in July 2023. Students suspected AI use due to irregularities in the image, and NESA initially declined to confirm. After the Sydney Morning Herald confirmed the image was AI-generated, NESA stated that students would be marked on their response to the question, not the image's origin.

Company involved
NSW Education Standards Authority
AI system involved
ChatGPT and Dall-E 2

6 source articles · read the reporting →

WF-FYG1621 Jan 2020

AI drug discovery system repurposed to generate toxic molecules in demonstration

In 2020, Collaborations Pharmaceuticals demonstrated that its AI drug discovery system, MegaSyn, could be repurposed to generate toxic molecules similar to the nerve agent VX. The company ran the software overnight and produced 40,000 potentially hazardous substances. The researchers presented their findings at a conference and briefed the White House, warning that such AI systems could be misused to create chemical weapons.

Company involved
Collaborations Pharmaceuticals
AI system involved
MegaSyn

10 source articles · read the reporting →

WF-52Q1NZ26 Feb 2021

Qoves facial assessment tool ranks journalist's attractiveness and suggests procedures

Tate Ryan-Mosley, a journalist at MIT Technology Review, used Qoves Studio's AI facial assessment tool, which automatically scored her face and listed perceived flaws such as smile lines and under-eye bags. The tool recommended skin-care products and paid surgical consultation reports. She also tried Megvii's Face++ beauty-scoring system, which gave her two percentage attractiveness scores. The article raises concerns that such algorithms are inaccurate, biased and not transparently used by social media platforms.

Company involved
Qoves Studio
AI system involved
Facial Assessment Tool

9 source articles · read the reporting →

WF-ZQ3YFL1 Dec 2020

Retorio AI personality test swayed by candidate appearance in BR experiment

Bayerischer Rundfunk journalists conducted experiments with Retorio's AI video interview analysis tool. The AI, which assesses personality traits from short videos, produced different scores when the same actress changed her appearance (glasses, headscarf, wig) or the video background and lighting were altered. The start-up Retorio acknowledged that the AI considers external image, similar to a human interviewer. Experts warned that such software could perpetuate stereotypes and unfairly affect job candidates.

AI system involved
Retorio AI

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

page 1 of 2Older →