The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “NVIDIA DRIVE AGX Hyperion 10” · matched on meaning · public reporting

WF-JX049M10 Oct 2024

Alcon Entertainment sues Tesla and Elon Musk over AI-generated Blade Runner 2049 imagery

Alcon Entertainment, the producer of Blade Runner 2049, has sued Tesla, Elon Musk, and Warner Bros Discovery, alleging they used AI to create promotional imagery based on the film for Tesla's robotaxi launch event on 10 October 2024. Alcon claims it had specifically denied a request from Warner Bros to use material from the film. The lawsuit alleges misappropriation and false endorsement, and describes the financial magnitude of the misappropriation as substantial.

Company involved
Tesla

6 source articles · read the reporting →

Google Antigravity AI Deletes User's Entire Drive Partition

A user of Google's Antigravity AI coding platform lost all data on their D: drive after the AI agent executed a command with a path parsing error. The AI ran 'rmdir /s /q d:\' while in Turbo mode, which allows automatic terminal commands without user approval. The user, a photographer, was unable to recover most files using data recovery software. The incident highlights the risks of granting AI agents unrestricted access to local systems.

Company involved
Google
AI system involved
Antigravity

2 source articles · read the reporting →

WF-QXCVQM20 Apr 2026

Waymo recalls 3,500 robotaxis after vehicle enters flooded Texas road

On April 20, 2026, an unoccupied Waymo robotaxi entered a flooded road in San Antonio, Texas, during severe weather. No injuries occurred, but the incident prompted Waymo to issue a voluntary recall of up to 3,791 vehicles due to software that could allow the cars to drive onto flooded roads. The National Highway Traffic Safety Administration published recall documents, and Waymo stated it is implementing additional software safeguards and has restricted operations in extreme weather. The fix is still under development.

Company involved
Waymo
AI system involved
Waymo autonomous driving system

4 source articles · read the reporting →

WF-R8X8FN27 Nov 2018

Ningbo police AI falsely accuses woman in bus ad of jaywalking

An AI jaywalking detection system used by police in Ningbo, China, mistakenly identified a photograph of Dong Mingzhu, head of Gree Electric, on a bus advertisement as a real person jaywalking. Her image and name were briefly displayed on a public shaming billboard. Police acknowledged the error, deleted the photo, and stated they would update the system to distinguish advertisements from people. Gree Electric thanked the police for their response.

Company involved
Ningbo police

10 source articles · read the reporting →

WF-RFC7HZ9 Feb 2025

Tesla Cybertruck on Full Self-Driving Crashes into Pole in Reno

A Tesla Cybertruck owner in Reno, Nevada, reported that his vehicle, operating on Full Self-Driving version 13.2.4, failed to merge from a lane that was ending and drove onto a curb, striking a light pole. The driver, Jonathan Challinger, was uninjured and praised Tesla's safety, while acknowledging he should have been paying attention. The incident occurred on Stead Boulevard with no other traffic present, and the owner attempted to contact Tesla's service centre, which was reportedly unresponsive.

Company involved
Tesla
AI system involved
Full Self-Driving v13.2.4

8 source articles · read the reporting →

WF-RQ6Z5D10 Jul 2024

Google's Gemini AI Allegedly Scans Private Drive PDFs Without Permission

Kevin Bankston, a privacy activist, alleges that Google's Gemini AI automatically summarised his private tax return PDF in Google Drive without his explicit consent. Google disputes this, stating that the feature requires proactive user enabling and that data is not stored. Bankston found the relevant settings were already disabled, suggesting a possible glitch or override from a prior Workspace Labs enrolment.

Company involved
Google
AI system involved
Gemini AI

1 source article · read the reporting →

WF-S2AEBR1 Nov 2021

Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops

Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD) beta

5 source articles · read the reporting →

Hikvision sells Uyghur recognition system to Chinese authorities

Hikvision, a Chinese surveillance company, sold a facial recognition system powered by NVIDIA to authorities in the People's Republic of China. The system is designed to identify Uyghur individuals, enabling ethnic profiling and surveillance. The article reports that the system was marketed as a tool for public security and was deployed without transparency or accountability. No specific incident of harm is described, but the potential for widespread discrimination and human rights abuses is highlighted.

Company involved
Hikvision
AI system involved
Uyghur recognition system

10 source articles · read the reporting →

WF-U8SFC923 Jul 2021

Tesla Autopilot mistakes moon for yellow traffic light, causing car to slow down

A Tesla driver reported that the vehicle's Autopilot system misidentified the moon as a yellow traffic light, causing the car to slow down unexpectedly. The driver alerted Tesla CEO Elon Musk via social media on July 23, 2021. No collision or injury was reported, but the incident highlights a potential safety issue with the object detection system.

Company involved
Tesla
AI system involved
Autopilot

3 source articles · read the reporting →

WF-QZVA9D2 Jun 2021

Tesla Full Self-Driving confused by truck carrying traffic lights

A Tesla vehicle using Full Self-Driving mode encountered a truck loaded with traffic lights. The system identified the traffic lights on the truck but was unable to determine the correct action, creating a confusing edge case. The incident was shared on social media, highlighting a limitation of the autonomous driving system.

Company involved
Tesla
AI system involved
Full Self-Driving

2 source articles · read the reporting →

WF-W2FDR42 Apr 2022

Cruise autonomous vehicle briefly evades police traffic stop

On April 2, 2022, a driverless Cruise taxi in San Francisco was pulled over by police for driving without headlights. The vehicle initially drove away before stopping at a safe location, confusing officers. Cruise stated the car yielded as programmed and no citation was issued. The incident highlights challenges of autonomous vehicles interacting with law enforcement.

Company involved
Cruise

5 source articles · read the reporting →

Hackers trick Tesla Autopilot into veering into oncoming lane

Researchers at Tencent's Keen Security Lab demonstrated that stickers placed on a road could trick a Tesla Model S's Autopilot system into veering into the oncoming traffic lane. The attack exploited the system's reliance on camera-based computer vision to recognise lanes. Tesla responded that this vulnerability was unrealistic because a driver can easily override Autopilot, while saying a separate steering-wheel hijack had been fixed in a software update.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs

Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.

AI system involved
Mobileye ADAS

7 source articles · read the reporting →

Nvidia releases AI-powered Eye Contact feature for Broadcast app

Nvidia has released a beta version of Eye Contact, an AI-powered feature for its Broadcast app that replaces a user's eyes in video streams with simulated eyeballs that always face the camera. The feature is intended to maintain eye contact even when the user looks away, but social media response has been largely negative. A former TV news anchor said that unbroken eye contact can be regarded as creepy or uncomfortable.

Company involved
Nvidia
AI system involved
Eye Contact

8 source articles · read the reporting →

WF-QWGD1Q25 Jun 2015

Delphi denies near-miss between its self-driving car and Google's autonomous vehicle

Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.

Company involved
Delphi Automotive
AI system involved
Delphi self-driving car (Audi Q5 SUV)

7 source articles · read the reporting →

WF-KXXONZ1 Jan 2020

Tesla Autopilot stops for phantom stop sign on digital billboard

Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.

Company involved
Tesla
AI system involved
Tesla Autopilot

9 source articles · read the reporting →

WF-CQ2Y4G1 Jan 2019

Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade

In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.

Company involved
Ministry of Interior
AI system involved
Huawei smart surveillance cameras

10 source articles · read the reporting →

WF-Z7NWDE7 Sep 2021

Singapore deploys Xavier robots to patrol public areas for rule-breaking

Singapore's Home Team Science and Technology Agency has deployed Xavier robots to patrol Toa Payoh Central. The robots use AI to detect 'undesirable social behaviours' including gatherings of more than five people, smoking in prohibited areas, illegal hawking, improperly parked bicycles, and mobility devices on footpaths. When detected, the robots alert their command centre and display educational messages. The three-week trial aims to reduce the need for physical patrols by human officers.

Company involved
Singapore Home Team Science and Technology Agency
AI system involved
Xavier

8 source articles · read the reporting →

Google Health's diabetic retinopathy AI faced real-world issues in Thailand clinics

Google Health deployed a deep-learning system to screen for diabetic retinopathy in 11 clinics across Thailand. The AI was highly accurate in lab tests but rejected over a fifth of eye scans in real-world conditions due to poor lighting and slow internet. Patients whose scans were rejected had to visit specialists at other clinics, causing inconvenience and frustration for nurses. Google Health is now working with local staff to improve the system's workflow.

Company involved
Google Health

10 source articles · read the reporting →

Cruise alleged to rely on human operators for autonomous driving

A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.

Company involved
Cruise
AI system involved
Cruise AV

9 source articles · read the reporting →

WF-9YWZ621 Oct 2023

Authors sue Nvidia for copyright infringement in NeMo AI training

Three authors have filed a proposed class action against Nvidia, alleging the company used their copyrighted books without permission to train its NeMo AI platform. The dataset, containing approximately 196,640 volumes, was removed in October 2023 after copyright infringement reports. The authors are seeking unspecified damages on behalf of US writers whose works were used in the past three years.

Company involved
Nvidia
AI system involved
NeMo

9 source articles · read the reporting →

YouTube creator sues Nvidia and OpenAI over video scraping

David Millette filed a federal lawsuit alleging Nvidia and OpenAI scraped his YouTube videos without permission to train their AI models. The lawsuit seeks class action status and alleges unjust enrichment and unfair competition. Nvidia denied wrongdoing, stating it respects content creators' rights.

Company involved
Nvidia
AI system involved
Cosmos AI

10 source articles · read the reporting →

Study finds driverless car AI worse at detecting darker-skinned pedestrians

A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.

AI system involved
BDD100K

9 source articles · read the reporting →

WF-K5NHEN24 Nov 2022

Tesla's Full Self-Driving involved in fatal Bay Bridge crash

On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.

Company involved
Tesla
AI system involved
Full Self-Driving

7 source articles · read the reporting →

← Newerpage 3 of 4Older →