The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “NVIDIA DRIVE AV” · matched on meaning · public reporting

Volvo self-driving car blinded by snow in Sweden test

During testing in Jokkmokk, Sweden, a Volvo self-driving XC90 SUV's radar sensors became caked with frozen flakes, rendering the vehicle unable to read the road. The incident highlighted the challenge of snow blindness for autonomous vehicles. Ford engineers later proposed a solution using lidar to create high-definition 3-D maps.

Company involved
Volvo Cars
AI system involved
self-driving XC90 SUV

4 source articles · read the reporting →

WF-HQESEZ13 May 2023

Tesla's Full Self-Driving Beta fails to stop for pedestrian at crosswalk

A video posted online shows a Tesla vehicle using the Full Self-Driving Beta software detecting a pedestrian at a crosswalk in San Francisco but not stopping, only slowing from 26 mph to 24 mph after passing. The incident highlights the system's failure to comply with California law requiring drivers to yield to pedestrians. Tesla has faced regulatory scrutiny from NHTSA over unsafe behaviours around intersections, and this video adds to concerns about the safety of the unfinished software being tested on public roads.

Company involved
Tesla
AI system involved
Full Self-Driving Beta

5 source articles · read the reporting →

WF-NJX5PW24 Jul 2026

Truck drivers sue Motive over AI dash cam mass surveillance

Truck drivers Adam Dean and Christian Erickson filed a class action lawsuit against Motive Technologies Inc., alleging that the company's AI-powered dash cams with automatic license plate readers collected license plate data and tracked drivers' movements without consent. The lawsuit, filed in California federal court, claims violations of California's ALPR Law and seeks damages of $2,500 per class member. The drivers allege privacy invasion and emotional distress from the surreptitious surveillance.

Company involved
Motive Technologies Inc.

1 source article · read the reporting →

WF-J8EHEE23 Sep 2021

Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured

On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.

Company involved
Xpeng Motors
AI system involved
NGP automatic navigation assisted driving system

1 source article · read the reporting →

WF-P25C8Q16 Feb 2023

Tesla Recalls 360,000 Vehicles with Full Self-Driving Beta Over Crash Risk

Tesla is recalling more than 360,000 vehicles equipped with its Full Self-Driving Beta software after a government regulator found that the cars could proceed through intersections without stopping, posing a crash risk. The company said it would issue a remote software update to remedy the problem. The recall is a significant setback for Tesla's autonomous driving ambitions.

Company involved
Tesla
AI system involved
Full Self-Driving Beta

10 source articles · read the reporting →

WF-JX049M10 Oct 2024

Alcon Entertainment sues Tesla and Elon Musk over AI-generated Blade Runner 2049 imagery

Alcon Entertainment, the producer of Blade Runner 2049, has sued Tesla, Elon Musk, and Warner Bros Discovery, alleging they used AI to create promotional imagery based on the film for Tesla's robotaxi launch event on 10 October 2024. Alcon claims it had specifically denied a request from Warner Bros to use material from the film. The lawsuit alleges misappropriation and false endorsement, and describes the financial magnitude of the misappropriation as substantial.

Company involved
Tesla

6 source articles · read the reporting →

WF-S2AEBR1 Nov 2021

Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops

Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD) beta

5 source articles · read the reporting →

WF-TTLKR63 Jun 2022

Cruise Recalls Self-Driving Software After San Francisco Crash Injures Two

In June 2022, a Cruise autonomous vehicle operating in San Francisco attempted an unprotected left turn and braked hard after incorrectly predicting an oncoming car would turn right. The other car continued straight and struck the Cruise vehicle, injuring a Cruise employee and a person in the other car. Cruise subsequently recalled the software on 80 vehicles, temporarily restricted left turns, and issued a software update to improve predictions. The US National Highway Traffic Safety Administration oversaw the recall.

Company involved
Cruise

7 source articles · read the reporting →

WF-W2FDR42 Apr 2022

Cruise autonomous vehicle briefly evades police traffic stop

On April 2, 2022, a driverless Cruise taxi in San Francisco was pulled over by police for driving without headlights. The vehicle initially drove away before stopping at a safe location, confusing officers. Cruise stated the car yielded as programmed and no citation was issued. The incident highlights challenges of autonomous vehicles interacting with law enforcement.

Company involved
Cruise

5 source articles · read the reporting →

Hackers trick Tesla Autopilot into veering into oncoming lane

Researchers at Tencent's Keen Security Lab demonstrated that stickers placed on a road could trick a Tesla Model S's Autopilot system into veering into the oncoming traffic lane. The attack exploited the system's reliance on camera-based computer vision to recognise lanes. Tesla responded that this vulnerability was unrealistic because a driver can easily override Autopilot, while saying a separate steering-wheel hijack had been fixed in a software update.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs

Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.

AI system involved
Mobileye ADAS

7 source articles · read the reporting →

Nvidia releases AI-powered Eye Contact feature for Broadcast app

Nvidia has released a beta version of Eye Contact, an AI-powered feature for its Broadcast app that replaces a user's eyes in video streams with simulated eyeballs that always face the camera. The feature is intended to maintain eye contact even when the user looks away, but social media response has been largely negative. A former TV news anchor said that unbroken eye contact can be regarded as creepy or uncomfortable.

Company involved
Nvidia
AI system involved
Eye Contact

8 source articles · read the reporting →

WF-QWGD1Q25 Jun 2015

Delphi denies near-miss between its self-driving car and Google's autonomous vehicle

Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.

Company involved
Delphi Automotive
AI system involved
Delphi self-driving car (Audi Q5 SUV)

7 source articles · read the reporting →

WF-ROSQWB1 Sep 2019

Tesla Autopilot tricked into speeding by electrical tape on sign

Researchers from McAfee Labs demonstrated that a two-inch piece of black electrical tape stuck on a 35 mph speed limit sign can cause the Traffic Aware Cruise Control in older Tesla Model S and X vehicles to misread the sign as 85 mph and automatically accelerate. The vulnerability affects vehicles using the MobilEye EyeQ3 camera system (Hardware Pack 1). The driver can override by braking. Tesla and MobilEye were informed but did not commit to fixing the issue.

Company involved
Tesla
AI system involved
Tesla Autopilot (Hardware Pack 1 with MobilEye EyeQ3)

8 source articles · read the reporting →

WF-KXXONZ1 Jan 2020

Tesla Autopilot stops for phantom stop sign on digital billboard

Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.

Company involved
Tesla
AI system involved
Tesla Autopilot

9 source articles · read the reporting →

NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles

The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.

Company involved
Tesla Inc.
AI system involved
Autopilot

10 source articles · read the reporting →

WF-3U7P601 Jul 2022

California bill targets Tesla's Full Self-Driving name as misleading

The California legislature passed a bill that would require Tesla to stop using the term 'Full Self-Driving' for its driver-assistance system, following a complaint from the California DMV. The bill alleges that the name is misleading because the system still requires constant driver supervision and is not fully autonomous. The bill now awaits Governor Gavin Newsom's signature.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD)

10 source articles · read the reporting →

WF-DZERRH27 Feb 2021

Tesla Model X on Autopilot crashes into police car, injuring five officers

On February 27, 2021, a Tesla Model X operating on Autopilot crashed into a stationary police vehicle on a highway near Montgomery County, Texas, injuring five officers and hospitalizing the subject of a traffic stop. The driver was intoxicated and the system had alerted him 150 times to apply force to the steering wheel. The National Highway Traffic Safety Administration (NHTSA) is investigating the incident, along with 15 other similar crashes involving Teslas and emergency vehicles.

Company involved
Tesla
AI system involved
Autopilot

10 source articles · read the reporting →

Cruise alleged to rely on human operators for autonomous driving

A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.

Company involved
Cruise
AI system involved
Cruise AV

9 source articles · read the reporting →

YouTube creator sues Nvidia and OpenAI over video scraping

David Millette filed a federal lawsuit alleging Nvidia and OpenAI scraped his YouTube videos without permission to train their AI models. The lawsuit seeks class action status and alleges unjust enrichment and unfair competition. Nvidia denied wrongdoing, stating it respects content creators' rights.

Company involved
Nvidia
AI system involved
Cosmos AI

10 source articles · read the reporting →

Study finds driverless car AI worse at detecting darker-skinned pedestrians

A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.

AI system involved
BDD100K

9 source articles · read the reporting →

WF-K5NHEN24 Nov 2022

Tesla's Full Self-Driving involved in fatal Bay Bridge crash

On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.

Company involved
Tesla
AI system involved
Full Self-Driving

7 source articles · read the reporting →

Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck

司机依赖“智驾 ”跑高速,逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网

A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.

1 source article · read the reporting →

Tesla Autopilot accidents and data leak suggest larger problems

Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

← Newerpage 3 of 4Older →