The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

92 incidents closest to “Blend Autopilot” · matched on meaning · public reporting

WF-FB2AXW7 Dec 2019

Tesla Model 3 on Autopilot crashes into police car in Connecticut

A Tesla Model 3 with Autopilot engaged crashed into a police cruiser and a disabled vehicle on I-95 in Connecticut. The driver stated he was checking on his dog in the back seat and not paying attention to the road. No serious injuries were reported. The incident highlights concerns about driver inattention when using partially automated driving systems.

Company involved
Tesla
AI system involved
Autopilot

2 source articles · read the reporting →

WF-FC5NXX19 May 2016

Tesla Model S on Autopilot crashes into stationary van on Swiss highway

A Tesla Model S owner in Switzerland was using the car's Autopilot and Adaptive Cruise Control on a highway when the system failed to detect a stationary van after the preceding vehicle changed lanes. The car accelerated slightly and collided with the van, causing front-end damage that required replacement of parts including a parking sensor and a steel beam. The driver acknowledged they could have reacted sooner but had grown to trust the system after many successful trips. Tesla's manual warns that the system may not brake for stationary vehicles in such situations.

Company involved
Tesla
AI system involved
Tesla Autopilot

3 source articles · read the reporting →

WF-GPYWHQ29 May 2018

Tesla Autopilot crashes into parked police SUV in Laguna Beach

On 29 May 2018, Dave Key's Tesla Model S, operating in Autopilot mode, drifted out of its lane and collided with a parked police SUV in Laguna Beach, California. No one was injured, but the car was written off. The crash was attributed to a known limitation of Tesla's AI, which struggled to distinguish stationary objects from the background. Key, a former software entrepreneur, later bought three more Teslas and used the Full Self-Driving beta.

Company involved
Tesla
AI system involved
Autopilot

4 source articles · read the reporting →

WF-J8EHEE23 Sep 2021

Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured

On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.

Company involved
Xpeng Motors
AI system involved
NGP automatic navigation assisted driving system

1 source article · read the reporting →

WF-S2AEBR1 Nov 2021

Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops

Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.

Company involved
Tesla
AI system involved
Full Self-Driving (FSD) beta

5 source articles · read the reporting →

WF-TDZYDS17 Mar 2021

Tesla on Autopilot crashes into stationary Michigan police car

A Tesla with Autopilot engaged struck a stationary Michigan State Police vehicle on a freeway on 17 March 2021. Neither the driver nor the system avoided the collision, causing serious damage to the police car but no injuries. The driver was cited for driving with a suspended license. The incident adds to concerns about Tesla's driver-assistance system and its marketing.

Company involved
Tesla, Inc.
AI system involved
Autopilot

6 source articles · read the reporting →

WF-TTLKR63 Jun 2022

Cruise Recalls Self-Driving Software After San Francisco Crash Injures Two

In June 2022, a Cruise autonomous vehicle operating in San Francisco attempted an unprotected left turn and braked hard after incorrectly predicting an oncoming car would turn right. The other car continued straight and struck the Cruise vehicle, injuring a Cruise employee and a person in the other car. Cruise subsequently recalled the software on 80 vehicles, temporarily restricted left turns, and issued a software update to improve predictions. The US National Highway Traffic Safety Administration oversaw the recall.

Company involved
Cruise

7 source articles · read the reporting →

WF-W2FDR42 Apr 2022

Cruise autonomous vehicle briefly evades police traffic stop

On April 2, 2022, a driverless Cruise taxi in San Francisco was pulled over by police for driving without headlights. The vehicle initially drove away before stopping at a safe location, confusing officers. Cruise stated the car yielded as programmed and no citation was issued. The incident highlights challenges of autonomous vehicles interacting with law enforcement.

Company involved
Cruise

5 source articles · read the reporting →

Hackers trick Tesla Autopilot into veering into oncoming lane

Researchers at Tencent's Keen Security Lab demonstrated that stickers placed on a road could trick a Tesla Model S's Autopilot system into veering into the oncoming traffic lane. The attack exploited the system's reliance on camera-based computer vision to recognise lanes. Tesla responded that this vulnerability was unrealistic because a driver can easily override Autopilot, while saying a separate steering-wheel hijack had been fixed in a software update.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

WF-15ED3I4 May 2021

Man rides in back seat of Tesla using autopilot on Bay Area roads

A man was recorded sitting in the back seat of a Tesla Model 3 while it drove on autopilot with no one in the driver's seat on Bay Area roads. The video was shared online and the California Highway Patrol is investigating. A witness who reported the incident said Tesla customer service told him to contact CHP, and CHP initially said there was nothing they could do. The stunt highlights concerns about Tesla's autopilot feature being used without a driver.

Company involved
Tesla
AI system involved
Tesla Autopilot

9 source articles · read the reporting →

WF-ROSQWB1 Sep 2019

Tesla Autopilot tricked into speeding by electrical tape on sign

Researchers from McAfee Labs demonstrated that a two-inch piece of black electrical tape stuck on a 35 mph speed limit sign can cause the Traffic Aware Cruise Control in older Tesla Model S and X vehicles to misread the sign as 85 mph and automatically accelerate. The vulnerability affects vehicles using the MobilEye EyeQ3 camera system (Hardware Pack 1). The driver can override by braking. Tesla and MobilEye were informed but did not commit to fixing the issue.

Company involved
Tesla
AI system involved
Tesla Autopilot (Hardware Pack 1 with MobilEye EyeQ3)

8 source articles · read the reporting →

WF-KXXONZ1 Jan 2020

Tesla Autopilot stops for phantom stop sign on digital billboard

Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.

Company involved
Tesla
AI system involved
Tesla Autopilot

9 source articles · read the reporting →

NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles

The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.

Company involved
Tesla Inc.
AI system involved
Autopilot

10 source articles · read the reporting →

WF-DZERRH27 Feb 2021

Tesla Model X on Autopilot crashes into police car, injuring five officers

On February 27, 2021, a Tesla Model X operating on Autopilot crashed into a stationary police vehicle on a highway near Montgomery County, Texas, injuring five officers and hospitalizing the subject of a traffic stop. The driver was intoxicated and the system had alerted him 150 times to apply force to the steering wheel. The National Highway Traffic Safety Administration (NHTSA) is investigating the incident, along with 15 other similar crashes involving Teslas and emergency vehicles.

Company involved
Tesla
AI system involved
Autopilot

10 source articles · read the reporting →

Cruise alleged to rely on human operators for autonomous driving

A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.

Company involved
Cruise
AI system involved
Cruise AV

9 source articles · read the reporting →

WF-K5NHEN24 Nov 2022

Tesla's Full Self-Driving involved in fatal Bay Bridge crash

On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.

Company involved
Tesla
AI system involved
Full Self-Driving

7 source articles · read the reporting →

Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck

司机依赖“智驾 ”跑高速,逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网

A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.

1 source article · read the reporting →

Tesla Autopilot accidents and data leak suggest larger problems

Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

Bo Yu Long Zhu Fishing Download: Tesla Autopilot Another Fatal Accident, Owner's Family Demands Full Logs - Pchome Computer Home

博鱼龙珠捕鱼下载特斯拉自动驾驶再出致命事故,车主家属要求公开完整日志 - Pchome电脑之家

A fatal accident involving Tesla's autopilot has occurred again. The family of the car owner is demanding that the complete logs be released.

Company involved
Tesla
AI system involved
Autopilot

1 source article · read the reporting →

WF-2016G520 Apr 2021

Consumer Reports finds Tesla Autopilot operates without driver

Consumer Reports engineers tested a Tesla Model Y on a closed track and found that the Autopilot system could operate the vehicle without anyone in the driver's seat, failing to warn or detect the absence of a driver. The test highlighted a safety flaw as investigators probed a fatal crash in Texas where two men died in a Tesla Model S believed to be operating without a driver. Tesla did not respond to a request for comment.

Company involved
Tesla
AI system involved
Autopilot

10 source articles · read the reporting →

WF-3T6VVX1 Jun 2020

Tesla on Autopilot Crashes into Overturned Truck on Taiwan Highway

On 1 June 2020, a Tesla sedan with Autopilot engaged failed to detect an overturned delivery truck on National Highway 1 in Taiwan and collided with it. The driver, a 53-year-old man, had set the system to 110 km/h and assumed it would avoid obstacles, but he braked too late. The truck driver, who was standing on the highway after his own accident, narrowly avoided being struck. No serious injuries were reported, and police are investigating the cause, with possible factors including the truck's unusual shape and the system's limitation to detecting only moving vehicles.

AI system involved
Autopilot

3 source articles · read the reporting →

WF-ZIOKPY29 Dec 2023

Tesla Model Y crash, 1 killed, Autopilot verified: Tesla crosses into incoming traffic, hit, and spins off road

The Tesla's Autopilot system steered the vehicle into oncoming traffic, causing a collision that killed a 12-year-old and injured five others.

Company involved
Tesla
AI system involved
Autopilot

1 source article · read the reporting →

WF-NN92D919 Jan 2018

Tesla Driver Passed Out Drunk on Bay Bridge Claims Autopilot Was in Control

On 19 January 2018, a Tesla driver was found passed out behind the wheel on the San Francisco Bay Bridge with a blood alcohol content over twice the legal limit. The driver told California Highway Patrol officers that the vehicle had been set on Autopilot. The driver was arrested and charged with driving under the influence, and the car was towed. No accident or injuries occurred, and Tesla did not confirm whether Autopilot was engaged.

Company involved
Tesla
AI system involved
Autopilot

10 source articles · read the reporting →

WF-C1FGCE19 Aug 2025

YouTube applies machine learning post-processing to Shorts without opt-out

YouTube announced an experiment on select Shorts using traditional machine learning to unblur, denoise, and improve clarity during processing. Creators reported that this altered their videos' appearance without an opt-out option, and some accused YouTube of misleading about the use of AI. YouTube acknowledged the experiment and said it would consider feedback, but did not offer a rollback or opt-out.

Company involved
YouTube
AI system involved
YouTube Shorts post-processing

7 source articles · read the reporting →

← Newerpage 3 of 4Older →