The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “NVIDIA Alpamayo” · matched on meaning · public reporting

Google Photos AI panorama creates giant head in ski photo

Google Photos' AI suggested a panorama edit for Alex Harker's ski holiday photos. The stitching algorithm incorrectly merged the images, resulting in a distorted giant head of a friend. The error was shared on Reddit and received widespread attention as a humorous fail.

Company involved
Google
AI system involved
Google Photos

5 source articles · read the reporting →

Hikvision sells Uyghur recognition system to Chinese authorities

Hikvision, a Chinese surveillance company, sold a facial recognition system powered by NVIDIA to authorities in the People's Republic of China. The system is designed to identify Uyghur individuals, enabling ethnic profiling and surveillance. The article reports that the system was marketed as a tool for public security and was deployed without transparency or accountability. No specific incident of harm is described, but the potential for widespread discrimination and human rights abuses is highlighted.

Company involved
Hikvision
AI system involved
Uyghur recognition system

10 source articles · read the reporting →

WF-38XW641 Jan 2017

Hong Kong tycoon sues Tyndaris over AI hedge fund losses

Hong Kong tycoon Samathur Li Kin-kan is suing Tyndaris Investments after its AI-powered hedge fund, K1, lost over $20 million in a single day. Li alleges that the system was not as sophisticated as claimed. The trial is set to begin in London in April 2020.

Company involved
Tyndaris Investments
AI system involved
K1

10 source articles · read the reporting →

Glasgow AI mural design sparks criticism from local artists

Balmoral Estates used AI to generate a design mock-up for a planned mural on Elmbank Street in Glasgow. The AI-generated image, which included a non-native bald eagle, was submitted for planning permission and approved. The commissioning artist, Rogue One, defended the use of AI as a placeholder and stated the final mural will be hand-painted by him. Critics argue human artists should have been involved from the start.

Company involved
Balmoral Estates

4 source articles · read the reporting →

Fake Luma Dream Machine AI sites deliver Noodlophile infostealer

Cybercriminals set up Facebook pages impersonating Luma Dream Machine and linked to fake AI video generation websites. Users who uploaded images received an archive containing a malicious executable instead of a video. The executable launched a multi-stage attack that installed Noodlophile, which harvests browser credentials, cookies and cryptocurrency wallet information. Morphisec reported the campaign.

8 source articles · read the reporting →

WF-XYG9F420 Jun 2020

Duke University's PULSE AI upscaler turns Barack Obama white due to racial bias

Duke University researchers developed PULSE, an AI tool that upscales blurry face photos using Nvidia's StyleGAN model. When tested, it generated a white face from a pixelated image of Barack Obama, revealing racial bias. The bias stemmed from StyleGAN's training data being predominantly white and the evaluation dataset CelebA being 90% white. The researchers acknowledged the issue and updated their paper, while Nvidia stated it is working to mitigate bias.

Company involved
Duke University
AI system involved
PULSE

2 source articles · read the reporting →

Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs

Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.

AI system involved
Mobileye ADAS

7 source articles · read the reporting →

Nvidia releases AI-powered Eye Contact feature for Broadcast app

Nvidia has released a beta version of Eye Contact, an AI-powered feature for its Broadcast app that replaces a user's eyes in video streams with simulated eyeballs that always face the camera. The feature is intended to maintain eye contact even when the user looks away, but social media response has been largely negative. A former TV news anchor said that unbroken eye contact can be regarded as creepy or uncomfortable.

Company involved
Nvidia
AI system involved
Eye Contact

8 source articles · read the reporting →

WF-I6R3LD1 Mar 2023

Stanford takes down Alpaca AI demo over safety and cost concerns

Stanford University took down the web demo of its Alpaca AI language model due to safety and cost concerns. The model, based on Meta's LLaMA, was fine-tuned to follow instructions but could generate misinformation and toxic text. Researchers decided to remove the demo after it became publicly accessible, citing inadequate content filters and rising hosting costs.

Company involved
Stanford University
AI system involved
Alpaca

10 source articles · read the reporting →

Google Health's diabetic retinopathy AI faced real-world issues in Thailand clinics

Google Health deployed a deep-learning system to screen for diabetic retinopathy in 11 clinics across Thailand. The AI was highly accurate in lab tests but rejected over a fifth of eye scans in real-world conditions due to poor lighting and slow internet. Patients whose scans were rejected had to visit specialists at other clinics, causing inconvenience and frustration for nurses. Google Health is now working with local staff to improve the system's workflow.

Company involved
Google Health

10 source articles · read the reporting →

WF-CCZEWP1 Nov 2024

Magnum photographer Carl De Keyzer uses AI to create controversial photo series

Magnum photographer Carl De Keyzer used AI to create a photo series titled 'Putin's Dream' after a planned road trip to Russia was cancelled due to the war. He trained the AI with his own photographs to maintain his style. The images were posted online to promote the book, leading to outcry on social media and accusations of contributing to disinformation. De Keyzer deleted the images and had a conversation with Magnum about the project.

Company involved
Carl De Keyzer

4 source articles · read the reporting →

Tourists rescued after following ChatGPT route in Tatra mountains

Three Polish tourists used ChatGPT to plan a hiking route from Hala Gąsienicowa to Dolina Pięciu Stawów in the Tatra mountains. The AI recommended a difficult route through Przełęcz Krzyżne, which proved too dangerous in winter conditions with limited visibility and icy rocks. The tourists called the TOPR rescue service and were safely brought down. A TOPR rescuer advised against relying on ChatGPT or Google Maps for mountain route planning.

Company involved
OpenAI
AI system involved
ChatGPT

2 source articles · read the reporting →

WF-PMRIR418 Dec 2023

AI-driven Shadow Play network spreads pro-China propaganda on YouTube

The Australian Strategic Policy Institute (ASPI) revealed an extensive network of at least 30 YouTube channels, called Operation Shadow Play, that used generative AI to produce and publish pro-China and anti-US content. The network exploited YouTube's algorithmic recommendation system to cross-promote videos, gaining about 730,000 subscribers and 120 million views. The operation is alleged to be a coordinated influence campaign, possibly directed by a Mandarin-speaking controller, though the specific actor is unknown.

Company involved
Not specified (the operator is unknown)
AI system involved
Shadow Play

4 source articles · read the reporting →

WF-Y7PFHY1 Jan 2024

Wacom responds to concerns about AI-generated images in marketing assets

Wacom acknowledged that it may have used AI-generated images in US marketing assets for the New Year. The company stated it purchased the images from a third-party vendor who indicated they were not AI-generated, and that it vetted them using online tools that also indicated they were not AI-generated. After community feedback raised doubts, Wacom discontinued the images and is reviewing its processes to prevent recurrence. The company attributed the incident to misleading vendor information and detection tool limitations.

Company involved
Wacom

10 source articles · read the reporting →

WF-1S3KLV26 Nov 2024

OpenAI's Sora video generator leaked by group in protest

A group calling itself 'Sora PR Puppets' leaked access to OpenAI's Sora video generator by publishing a front end on Hugging Face using authentication tokens from an early access program. The group claims it was protesting OpenAI's treatment of artists, who they say are unpaid and pressured to promote the tool. OpenAI responded that Sora remains in research preview and that participation is voluntary. The leak was shut down after a few hours.

Company involved
OpenAI
AI system involved
Sora

5 source articles · read the reporting →

WF-6BTWTA8 Mar 2024

Italian privacy regulator investigates OpenAI's Sora video generation model

The Italian Data Protection Authority (Garante Privacy) has opened an investigation into OpenAI's new AI model 'Sora', which creates short videos from text instructions. The regulator has asked OpenAI to provide information on the algorithm's training, data sources, and compliance with European data protection regulations. OpenAI must respond within 20 days.

Company involved
OpenAI
AI system involved
Sora

7 source articles · read the reporting →

WF-9YWZ621 Oct 2023

Authors sue Nvidia for copyright infringement in NeMo AI training

Three authors have filed a proposed class action against Nvidia, alleging the company used their copyrighted books without permission to train its NeMo AI platform. The dataset, containing approximately 196,640 volumes, was removed in October 2023 after copyright infringement reports. The authors are seeking unspecified damages on behalf of US writers whose works were used in the past three years.

Company involved
Nvidia
AI system involved
NeMo

9 source articles · read the reporting →

WF-ZJEMQ525 Apr 2024

Huawei Pura 70 series AI editing tool removes clothing unintentionally

Huawei's Pura 70 series includes an AI retouching feature that can inadvertently remove clothing from images. Users on Weibo posted videos demonstrating this, raising privacy concerns. Huawei customer service acknowledged the issue, attributing it to algorithm loopholes, and promised a fix in upcoming system updates.

Company involved
Huawei
AI system involved
Pura 70 series AI retouching feature

5 source articles · read the reporting →

YouTube creator sues Nvidia and OpenAI over video scraping

David Millette filed a federal lawsuit alleging Nvidia and OpenAI scraped his YouTube videos without permission to train their AI models. The lawsuit seeks class action status and alleges unjust enrichment and unfair competition. Nvidia denied wrongdoing, stating it respects content creators' rights.

Company involved
Nvidia
AI system involved
Cosmos AI

10 source articles · read the reporting →

WF-NL6UK61 Jan 2020

Big Tech companies used YouTube videos to train AI without consent

Proof News found that subtitles from 173,536 YouTube videos were used by companies including Anthropic, Nvidia, Apple, and Salesforce to train AI models. The dataset, called YouTube Subtitles, was created by EleutherAI and published in 2020. Creators were not aware and some have expressed frustration, calling it theft. The companies have acknowledged using the dataset but argue it was publicly available.

Company involved
Anthropic, Nvidia, Apple, Salesforce, Bloomberg, Databricks
AI system involved
Claude, OpenELM

10 source articles · read the reporting →

WF-A4KNWS1 Oct 2025

OpenAI's Sora 2 allowed unauthorized use of Bryan Cranston's likeness

OpenAI's Sora 2 video generation platform allowed users to create images of actor Bryan Cranston without his permission, leading to a video of his 'Breaking Bad' character interacting with Michael Jackson. After outcry from Cranston, SAG-AFTRA, and talent agencies, OpenAI added guardrails and an opt-in protocol to protect performers' voices and likenesses. Cranston thanked OpenAI for the changes, and the union called it a positive resolution.

Company involved
OpenAI
AI system involved
Sora 2

6 source articles · read the reporting →

WF-0MLTX024 Jul 2021

Developer iperov releases DeepFaceLive real-time face-swap AI on GitHub

The developer iperov has published DeepFaceLive, a neural network for real-time face swapping, on GitHub. The tool automatically replaces a user's face in live streams and video calls with a nonexistent model or a celebrity, and the installation instructions are simple. The developer claims 95% of deepfakes on YouTube were made with the related DeepFaceLab. No specific harm is reported, but the article highlights the tool's potential for misuse.

Company involved
iperov
AI system involved
DeepFaceLive

7 source articles · read the reporting →

Bo Yu Long Zhu Fishing Download: Tesla Autopilot Another Fatal Accident, Owner's Family Demands Full Logs - Pchome Computer Home

博鱼龙珠捕鱼下载特斯拉自动驾驶再出致命事故,车主家属要求公开完整日志 - Pchome电脑之家

A fatal accident involving Tesla's autopilot has occurred again. The family of the car owner is demanding that the complete logs be released.

Company involved
Tesla
AI system involved
Autopilot

1 source article · read the reporting →

Adobe Firefly trained on thousands of Midjourney images, Bloomberg reports

Bloomberg has reported that Adobe's Firefly image generator was trained using thousands of images from competitor Midjourney. Adobe says these made up about 5% of the training data and were part of the Adobe Stock library. The company has marketed Firefly as ethically trained and offered enterprise customers indemnity against copyright claims. Adobe responded that all Adobe Stock images undergo moderation, but the report has raised questions about Firefly's copyright safety.

Company involved
Adobe
AI system involved
Firefly

7 source articles · read the reporting →

← Newerpage 2 of 3Older →