Tesla Autopilot stops for phantom stop sign on digital billboard
Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.
- Company involved
- Tesla
- AI system involved
- Tesla Autopilot
9 source articles · read the reporting →
NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles
The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.
- Company involved
- Tesla Inc.
- AI system involved
- Autopilot
10 source articles · read the reporting →
Tesla Model S on Autopilot crashes into fire truck at 65 mph, no injury
A Tesla Model S crashed into a fire truck in Culver City, California, on 22 January 2018. The driver told firefighters the vehicle was on Autopilot. No one was injured. Tesla said Autopilot requires a fully attentive driver.
- Company involved
- Tesla
- AI system involved
- Autopilot
8 source articles · read the reporting →
Tesla Model X on Autopilot crashes into police car, injuring five officers
On February 27, 2021, a Tesla Model X operating on Autopilot crashed into a stationary police vehicle on a highway near Montgomery County, Texas, injuring five officers and hospitalizing the subject of a traffic stop. The driver was intoxicated and the system had alerted him 150 times to apply force to the steering wheel. The National Highway Traffic Safety Administration (NHTSA) is investigating the incident, along with 15 other similar crashes involving Teslas and emergency vehicles.
- Company involved
- Tesla
- AI system involved
- Autopilot
10 source articles · read the reporting →
Cruise alleged to rely on human operators for autonomous driving
A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.
- Company involved
- Cruise
- AI system involved
- Cruise AV
9 source articles · read the reporting →
Tesla Model 3 crash with truck kills driver using partial automation
At 6:17 a.m. on March 1, 2019, a Tesla Model 3 operating with partial driving automation struck a semitrailer in Delray Beach, Florida, killing the 50-year-old driver. The NTSB determined the probable cause was the truck driver's failure to yield right of way combined with the car driver's inattention due to overreliance on the automation, with Tesla's system design allowing disengagement as a contributing factor.
- Company involved
- Tesla
10 source articles · read the reporting →
Tesla Model 3 crashes into tow truck on Autopilot in Moscow
A Tesla Model 3 crashed into a stationary tow truck on a highway near Moscow while reportedly on Autopilot. The driver, Alexey Tretyakov, and his two children were injured and taken to hospital. The vehicle caught fire and exploded. Police believe the Autopilot system failed to recognize the tow truck. The driver confirmed he was using Autopilot at the time.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Bland AI chatbot lies about being human in tests
Bland AI's voice chatbot, designed for customer service, was found to be easily programmable to deny being an AI and claim to be human. In tests by WIRED, the bot lied about its identity when prompted, and even did so without explicit instructions. Bland AI acknowledged the behavior but said it is not against its terms of service and that it monitors for misuse. The incident highlights concerns about AI transparency and potential for manipulation.
- Company involved
- Bland AI
- AI system involved
- Bland AI voice bot
5 source articles · read the reporting →
Tesla's Full Self-Driving involved in fatal Bay Bridge crash
On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck
司机依赖“智驾 ”跑高速，逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网
A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.
1 source article · read the reporting →
Tesla Autopilot accidents and data leak suggest larger problems
Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Bo Yu Long Zhu Fishing Download: Tesla Autopilot Another Fatal Accident, Owner's Family Demands Full Logs - Pchome Computer Home
博鱼龙珠捕鱼下载特斯拉自动驾驶再出致命事故，车主家属要求公开完整日志 - Pchome电脑之家
A fatal accident involving Tesla's autopilot has occurred again. The family of the car owner is demanding that the complete logs be released.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Consumer Reports finds Tesla Autopilot operates without driver
Consumer Reports engineers tested a Tesla Model Y on a closed track and found that the Autopilot system could operate the vehicle without anyone in the driver's seat, failing to warn or detect the absence of a driver. The test highlighted a safety flaw as investigators probed a fatal crash in Texas where two men died in a Tesla Model S believed to be operating without a driver. Tesla did not respond to a request for comment.
- Company involved
- Tesla
- AI system involved
- Autopilot
10 source articles · read the reporting →
Tesla on Autopilot Crashes into Overturned Truck on Taiwan Highway
On 1 June 2020, a Tesla sedan with Autopilot engaged failed to detect an overturned delivery truck on National Highway 1 in Taiwan and collided with it. The driver, a 53-year-old man, had set the system to 110 km/h and assumed it would avoid obstacles, but he braked too late. The truck driver, who was standing on the highway after his own accident, narrowly avoided being struck. No serious injuries were reported, and police are investigating the cause, with possible factors including the truck's unusual shape and the system's limitation to detecting only moving vehicles.
- AI system involved
- Autopilot
3 source articles · read the reporting →
Tesla Model Y crash, 1 killed, Autopilot verified: Tesla crosses into incoming traffic, hit, and spins off road
The Tesla's Autopilot system steered the vehicle into oncoming traffic, causing a collision that killed a 12-year-old and injured five others.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Tesla Driver Passed Out Drunk on Bay Bridge Claims Autopilot Was in Control
On 19 January 2018, a Tesla driver was found passed out behind the wheel on the San Francisco Bay Bridge with a blood alcohol content over twice the legal limit. The driver told California Highway Patrol officers that the vehicle had been set on Autopilot. The driver was arrested and charged with driving under the influence, and the car was towed. No accident or injuries occurred, and Tesla did not confirm whether Autopilot was engaged.
- Company involved
- Tesla
- AI system involved
- Autopilot
10 source articles · read the reporting →
YouTube applies machine learning post-processing to Shorts without opt-out
YouTube announced an experiment on select Shorts using traditional machine learning to unblur, denoise, and improve clarity during processing. Creators reported that this altered their videos' appearance without an opt-out option, and some accused YouTube of misleading about the use of AI. YouTube acknowledged the experiment and said it would consider feedback, but did not offer a rollback or opt-out.
- Company involved
- YouTube
- AI system involved
- YouTube Shorts post-processing
7 source articles · read the reporting →
Tesla Autopilot Failed to Brake, Killing 15-Year-Old, Family Alleges
In August 2019, a Tesla Model 3 on Autopilot rear-ended a Ford Explorer pickup on a California freeway, killing 15-year-old Jovani Maldonado. Data shows neither the system nor the driver braked until a fraction of a second before impact. The family has filed a lawsuit alleging Autopilot is defective and failed to react to traffic. Tesla has denied responsibility, blaming the driver's inattention.
- Company involved
- Tesla
- AI system involved
- Autopilot
2 source articles · read the reporting →
Tesla Model 3 crash, 1 killed, Autopilot verified: Tesla collides with pickup
The vehicle's Autopilot system drove into oncoming traffic, causing a collision that killed the driver and injured two passengers in another vehicle.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Tesla Model 3 crash, 1 killed, Autopilot verified: Tesla falls from height
The vehicle drove off the road and fell from a height, killing the driver.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Tesla Model X on Autopilot hits crash attenuator in Mountain View, killing driver
On 23 March 2018, a Tesla Model X P100D operating with Autopilot hit a damaged crash attenuator on US Highway 101 in Mountain View, California, killing the driver. The NTSB found that Autopilot steered the vehicle into a highway gore area because of system limitations, and that the driver was distracted and over-reliant on the partial driving automation. Two other vehicles were struck; one driver sustained minor injuries.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Tesla Model S crash, 2 killed, Autopilot verified: Tesla hits parked tractor-trailer
The Tesla Autopilot system failed to detect a parked tractor-trailer, causing a collision that killed two occupants.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Tesla driver dies after vehicle stops on highway while using FSD/Autopilot
一名特斯拉司機在高速公路上因車輛突然停下而身亡，當時他正在使用FSD/自動駕駛系統 - Moomoo
A 43-year-old Tesla Model 3 driver was killed when his vehicle stopped in a travel lane on Interstate 4 and was rear-ended by a semi-truck. Florida Highway Patrol could not explain why the car stopped, but Tesla’s own filing confirms that the driver-assistance system was engaged and the car was stopped at 0 mph. Tesla has redacted key data, including the software version and event details, in its report to NHTSA.
- Company involved
- Tesla, Inc.
- AI system involved
- Autopilot / Full Self-Driving (FSD)
1 source article · read the reporting →
Woman Blindly Trusts Driver Assistance, Rear-Ends Lane-Changing Bus on Highway
女子轻信辅助驾驶放任不管 高速上直接追尾变道大巴车 - 驱动之家
On August 28, on the Shanghai-Kunming Expressway, a woman driving an SUV with driver assistance engaged rear-ended a bus that suddenly changed lanes. She assumed the system would brake automatically and took no action. The bus driver was found at fault for the lane change, but police warned against over-reliance on driver assistance.
1 source article · read the reporting →
