The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

140 incidents closest to “Applied Intuition Self-Driving System” · matched on meaning · public reporting

WF-KXXONZ1 Jan 2020

Tesla Autopilot stops for phantom stop sign on digital billboard

Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.

Company involved
Tesla
AI system involved
Tesla Autopilot

9 source articles · read the reporting →

WF-3U7P601 Jul 2022

California bill targets Tesla's Full Self-Driving name as misleading

The California legislature passed a bill that would require Tesla to stop using the term 'Full Self-Driving' for its driver-assistance system, following a complaint from the California DMV. The bill alleges that the name is misleading because the system still requires constant driver supervision and is not fully autonomous. The bill now awaits Governor Gavin Newsom's signature.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD)

10 source articles · read the reporting →

WF-NA2P6C14 Dec 2016

California threatens legal action against Uber over self-driving cars without permit

Uber launched a pilot program of self-driving taxis in San Francisco without obtaining a required permit from the California DMV. Two of the vehicles were observed running red lights on the first day. The California attorney general threatened legal action unless Uber removes the cars from the road. Uber argued that its cars are not fully autonomous and therefore not subject to the permit requirement.

Company involved
Uber

10 source articles · read the reporting →

WF-3G1L4Z14 Feb 2016

Google self-driving car hits bus in first crash in which it was at fault

On 14 February 2016, a Google self-driving car sideswiped a public bus in Mountain View, California, in the first crash in which one of Google's autonomous vehicles was considered at fault. Google said the vehicle had tried to move around sandbags and struck the bus, and that the company bore some responsibility. No injuries were reported. Google said it had updated the vehicle's software to account for buses and other large vehicles.

Company involved
Google

10 source articles · read the reporting →

WF-RK2OLR12 Oct 2021

Waymo vehicles repeatedly turn around on San Francisco dead-end street

Residents of a dead-end street in San Francisco's Richmond District say Waymo self-driving cars have been driving down their street and making U-turns every five minutes for six to eight weeks. The constant hum of the vehicles has become a nuisance for neighbours working from home. Waymo said the cars were obeying road rules, taking a U-turn due to Slow Streets signage on Lake, and that it continually adjusts to dynamic San Francisco road rules.

Company involved
Waymo
AI system involved
Waymo Driver

9 source articles · read the reporting →

California DMV suspends Cruise LLC driverless and deployment permits

The California Department of Motor Vehicles suspended Cruise LLC's autonomous vehicle deployment and driverless testing permits, saying the vehicles were not safe for public operation and that Cruise had misrepresented safety information. The suspension took effect immediately under California regulations. Cruise may apply to reinstate the permits once it satisfies the department's requirements. Its permit for testing with a safety driver was not affected.

Company involved
Cruise LLC

10 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

Cruise alleged to rely on human operators for autonomous driving

A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.

Company involved
Cruise
AI system involved
Cruise AV

9 source articles · read the reporting →

WF-FA32HO1 Mar 2019

Tesla Model 3 crash with truck kills driver using partial automation

At 6:17 a.m. on March 1, 2019, a Tesla Model 3 operating with partial driving automation struck a semitrailer in Delray Beach, Florida, killing the 50-year-old driver. The NTSB determined the probable cause was the truck driver's failure to yield right of way combined with the car driver's inattention due to overreliance on the automation, with Tesla's system design allowing disengagement as a contributing factor.

Company involved
Tesla

10 source articles · read the reporting →

Study finds driverless car AI worse at detecting darker-skinned pedestrians

A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.

AI system involved
BDD100K

9 source articles · read the reporting →

WF-K5NHEN24 Nov 2022

Tesla's Full Self-Driving involved in fatal Bay Bridge crash

On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.

Company involved
Tesla
AI system involved
Full Self-Driving

7 source articles · read the reporting →

WF-YSKNCV6 Feb 2024

Waymo driverless car hits bicyclist in San Francisco intersection

On 6 February 2024, a Waymo driverless car collided with a bicyclist at a four-way intersection in San Francisco. The cyclist was obscured by a truck and the vehicle braked but could not stop in time. The cyclist sustained minor scratches and left the scene. Waymo stated it is contacting relevant authorities.

Company involved
Waymo

4 source articles · read the reporting →

Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck

司机依赖“智驾 ”跑高速,逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网

A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.

1 source article · read the reporting →

Tesla Autopilot accidents and data leak suggest larger problems

Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

WF-WEZH9412 Feb 2025

Tesla Cybertruck on Full Self-Driving swerves into oncoming traffic

A Tesla Cybertruck with Full Self-Driving (FSD) activated attempted to turn left into a driveway while an SUV approached from the opposite direction, nearly causing a head-on collision. The driver seized control and avoided the crash. The owner reported the incident on a forum, expressing concern about using FSD again. No injuries or damage occurred.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD)

3 source articles · read the reporting →

WF-9XSD5E23 Jan 2026

Waymo self-driving car hits child near Santa Monica school, US opens probe

A Waymo autonomous vehicle struck a child crossing the street near an elementary school in Santa Monica, California, on 23 January 2026, during school drop-off hours. The child sustained minor injuries. The US National Highway Traffic Safety Administration (NHTSA) and the National Transportation Safety Board (NTSB) have opened investigations into the incident. Waymo stated that the child emerged suddenly from behind a double-parked SUV and that the vehicle braked, reducing speed from 17 mph to under 6 mph before contact, and that a computer model suggested a human driver would have also hit the child.

Company involved
Waymo
AI system involved
Waymo

2 source articles · read the reporting →

WF-DXNU9O1 Aug 2025

Zoox recalls 332 robotaxis after self-driving cars veer into oncoming traffic

Zoox, Amazon's self-driving car company, recalled 332 robotaxis after they were found veering into oncoming traffic near intersections. The issue was first noticed in August 2025 when a car took a wide right turn crossing the center line. Zoox said no crashes or injuries occurred and fixed the problem with a software update. The National Highway Traffic Safety Administration confirmed the recall and is in ongoing discussions with Zoox.

Company involved
Zoox
AI system involved
Zoox robotaxis

6 source articles · read the reporting →

WF-4NBY2U13 May 2024

NHTSA investigation PE24016: Unexpected ADS behavior

Waymo's automated driving system exhibited unexpected behavior during driving.

Company involved
Waymo

1 source article · read the reporting →

WF-2016G520 Apr 2021

Consumer Reports finds Tesla Autopilot operates without driver

Consumer Reports engineers tested a Tesla Model Y on a closed track and found that the Autopilot system could operate the vehicle without anyone in the driver's seat, failing to warn or detect the absence of a driver. The test highlighted a safety flaw as investigators probed a fatal crash in Texas where two men died in a Tesla Model S believed to be operating without a driver. Tesla did not respond to a request for comment.

Company involved
Tesla
AI system involved
Autopilot

10 source articles · read the reporting →

WF-3T6VVX1 Jun 2020

Tesla on Autopilot Crashes into Overturned Truck on Taiwan Highway

On 1 June 2020, a Tesla sedan with Autopilot engaged failed to detect an overturned delivery truck on National Highway 1 in Taiwan and collided with it. The driver, a 53-year-old man, had set the system to 110 km/h and assumed it would avoid obstacles, but he braked too late. The truck driver, who was standing on the highway after his own accident, narrowly avoided being struck. No serious injuries were reported, and police are investigating the cause, with possible factors including the truck's unusual shape and the system's limitation to detecting only moving vehicles.

AI system involved
Autopilot

3 source articles · read the reporting →

WF-12MVIJ8 May 2024

Tesla Full Self-Driving system fails to recognise train, driver intervenes

A Tesla owner in Ohio reported that his car in Full Self-Driving mode attempted to drive into a crossing train on May 8, 2024. The driver took control and avoided a collision, but the car hit the crossing arm causing damage. The driver said it was the second such incident in six months. Tesla did not respond to requests for comment.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD)

8 source articles · read the reporting →

WF-AN9JEM11 Jun 2018

Cruise Self-Driving Car Rear-Ended by Human-Driven Cruise Vehicle in San Francisco

On 11 June 2018, a self-driving Cruise Chevrolet Bolt was rear-ended by another Cruise vehicle driven by a human employee on Bryant Street in San Francisco. The collision caused only minor scuffs and no injuries. Cruise reported the incident to the California DMV as required. The incident highlights the challenges of autonomous vehicles interacting with human drivers.

Company involved
Cruise

2 source articles · read the reporting →

AI-powered tram crashes into pedestrians in St Petersburg test run

An AI-powered 'Smart Tram' on a test run in St Petersburg, Russia, crashed into pedestrians after its AI system turned off and brakes failed. The driver, who was present, attempted to use emergency brakes but they did not fully work. Several people were injured, including a 45-year-old woman trapped under the tram. The city authorities have launched an investigation and a criminal case has been opened.

Company involved
St Petersburg city authorities
AI system involved
Smart Tram

1 source article · read the reporting →

WF-LKG3VJ1 Sep 2014

Google and Delphi Self-Driving Cars Involved in Minor Accidents in California

Four self-driving cars in California have been involved in accidents since September 2014, when the state began issuing testing permits. Two occurred while the cars were in autonomous mode, and two while a human was driving. Google and Delphi, the companies operating the vehicles, stated that their cars were not at fault and that the collisions were minor, with no injuries. The accidents have raised concerns about transparency, as details are kept confidential under state law.

Company involved
Google Inc. and Delphi Automotive

10 source articles · read the reporting →

← Newerpage 5 of 6Older →