Volvo self-driving car blinded by snow in Sweden test
During testing in Jokkmokk, Sweden, a Volvo self-driving XC90 SUV's radar sensors became caked with frozen flakes, rendering the vehicle unable to read the road. The incident highlighted the challenge of snow blindness for autonomous vehicles. Ford engineers later proposed a solution using lidar to create high-definition 3-D maps.
- Company involved
- Volvo Cars
- AI system involved
- self-driving XC90 SUV
4 source articles · read the reporting →
Tesla's Full Self-Driving Beta fails to stop for pedestrian at crosswalk
A video posted online shows a Tesla vehicle using the Full Self-Driving Beta software detecting a pedestrian at a crosswalk in San Francisco but not stopping, only slowing from 26 mph to 24 mph after passing. The incident highlights the system's failure to comply with California law requiring drivers to yield to pedestrians. Tesla has faced regulatory scrutiny from NHTSA over unsafe behaviours around intersections, and this video adds to concerns about the safety of the unfinished software being tested on public roads.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving Beta
5 source articles · read the reporting →
Waymo recalls robotaxi software after crash into telephone pole
On May 21, 2024, a Waymo autonomous vehicle crashed into a telephone pole in Phoenix, Arizona, while driving to a passenger pickup location. The vehicle was damaged but no one was injured. Waymo issued a voluntary recall and updated the software and mapping for its entire fleet of 672 vehicles to correct an error that assigned a low damage score to the pole and to improve the map.
- Company involved
- Waymo
- AI system involved
- Waymo autonomous vehicle
6 source articles · read the reporting →
Truck drivers sue Motive over AI dash cam mass surveillance
Truck drivers Adam Dean and Christian Erickson filed a class action lawsuit against Motive Technologies Inc., alleging that the company's AI-powered dash cams with automatic license plate readers collected license plate data and tracked drivers' movements without consent. The lawsuit, filed in California federal court, claims violations of California's ALPR Law and seeks damages of $2,500 per class member. The drivers allege privacy invasion and emotional distress from the surreptitious surveillance.
- Company involved
- Motive Technologies Inc.
1 source article · read the reporting →
Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured
On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.
- Company involved
- Xpeng Motors
- AI system involved
- NGP automatic navigation assisted driving system
1 source article · read the reporting →
Tesla Recalls 360,000 Vehicles with Full Self-Driving Beta Over Crash Risk
Tesla is recalling more than 360,000 vehicles equipped with its Full Self-Driving Beta software after a government regulator found that the cars could proceed through intersections without stopping, posing a crash risk. The company said it would issue a remote software update to remedy the problem. The recall is a significant setback for Tesla's autonomous driving ambitions.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving Beta
10 source articles · read the reporting →
Waymo recalls 3,500 robotaxis after vehicle enters flooded Texas road
On April 20, 2026, an unoccupied Waymo robotaxi entered a flooded road in San Antonio, Texas, during severe weather. No injuries occurred, but the incident prompted Waymo to issue a voluntary recall of up to 3,791 vehicles due to software that could allow the cars to drive onto flooded roads. The National Highway Traffic Safety Administration published recall documents, and Waymo stated it is implementing additional software safeguards and has restricted operations in extreme weather. The fix is still under development.
- Company involved
- Waymo
- AI system involved
- Waymo autonomous driving system
4 source articles · read the reporting →
Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops
Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving (FSD) beta
5 source articles · read the reporting →
Cruise Recalls Self-Driving Software After San Francisco Crash Injures Two
In June 2022, a Cruise autonomous vehicle operating in San Francisco attempted an unprotected left turn and braked hard after incorrectly predicting an oncoming car would turn right. The other car continued straight and struck the Cruise vehicle, injuring a Cruise employee and a person in the other car. Cruise subsequently recalled the software on 80 vehicles, temporarily restricted left turns, and issued a software update to improve predictions. The US National Highway Traffic Safety Administration oversaw the recall.
- Company involved
- Cruise
7 source articles · read the reporting →
Tesla Full Self-Driving confused by truck carrying traffic lights
A Tesla vehicle using Full Self-Driving mode encountered a truck loaded with traffic lights. The system identified the traffic lights on the truck but was unable to determine the correct action, creating a confusing edge case. The incident was shared on social media, highlighting a limitation of the autonomous driving system.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
2 source articles · read the reporting →
Speedcam Anywhere developers face abuse from UK drivers after app launch
Speedcam Anywhere, an app that uses AI to estimate the speed of passing vehicles, was launched in March 2022. Its developers have received abusive emails from drivers and are now hiding their identities. Google and Apple have not approved the app for distribution, and the Home Office has not vetted it for speeding prosecutions.
- AI system involved
- Speedcam Anywhere
10 source articles · read the reporting →
San Francisco residents lose sleep over Waymo cars honking at night
Residents of San Francisco's South of Market neighbourhood report being repeatedly woken up by driverless Waymo vehicles honking at each other in a nearby parking lot, particularly around 4 a.m. The cars appear to honk while manoeuvring into spaces in between rides. Waymo says it has identified the cause and is working on a fix.
- Company involved
- Waymo
2 source articles · read the reporting →
Center for Auto Safety petitions NHTSA over Nissan Rogue AEB false activations
The Center for Auto Safety petitioned NHTSA to investigate false activations of the Automatic Emergency Braking (AEB) system on 2017-2018 Nissan Rogue vehicles. The system reportedly engages abruptly when no obstruction is present, causing near misses and forcing following drivers to take evasive action. Nissan issued a Technical Service Bulletin to dealers but has not conducted a safety recall. The petition seeks a formal investigation and a determination that the defect poses an unreasonable risk to safety.
- Company involved
- Nissan
- AI system involved
- Automatic Emergency Braking (AEB)
5 source articles · read the reporting →
Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs
Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.
- AI system involved
- Mobileye ADAS
7 source articles · read the reporting →
Delphi denies near-miss between its self-driving car and Google's autonomous vehicle
Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.
- Company involved
- Delphi Automotive
- AI system involved
- Delphi self-driving car (Audi Q5 SUV)
7 source articles · read the reporting →
Tesla Autopilot tricked into speeding by electrical tape on sign
Researchers from McAfee Labs demonstrated that a two-inch piece of black electrical tape stuck on a 35 mph speed limit sign can cause the Traffic Aware Cruise Control in older Tesla Model S and X vehicles to misread the sign as 85 mph and automatically accelerate. The vulnerability affects vehicles using the MobilEye EyeQ3 camera system (Hardware Pack 1). The driver can override by braking. Tesla and MobilEye were informed but did not commit to fixing the issue.
- Company involved
- Tesla
- AI system involved
- Tesla Autopilot (Hardware Pack 1 with MobilEye EyeQ3)
8 source articles · read the reporting →
Tesla Autopilot stops for phantom stop sign on digital billboard
Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.
- Company involved
- Tesla
- AI system involved
- Tesla Autopilot
9 source articles · read the reporting →
NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles
The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.
- Company involved
- Tesla Inc.
- AI system involved
- Autopilot
10 source articles · read the reporting →
ViaQuatro's facial recognition system in São Paulo metro challenged in court
In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.
- Company involved
- ViaQuatro
- AI system involved
- Digital Interactive Doors System (DID system)
10 source articles · read the reporting →
Study finds driverless car AI worse at detecting darker-skinned pedestrians
A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.
- AI system involved
- BDD100K
9 source articles · read the reporting →
Tesla's Full Self-Driving involved in fatal Bay Bridge crash
On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Waymo driverless car hits bicyclist in San Francisco intersection
On 6 February 2024, a Waymo driverless car collided with a bicyclist at a four-way intersection in San Francisco. The cyclist was obscured by a truck and the vehicle braked but could not stop in time. The cyclist sustained minor scratches and left the scene. Waymo stated it is contacting relevant authorities.
- Company involved
- Waymo
4 source articles · read the reporting →
Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck
司机依赖“智驾 ”跑高速,逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网
A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.
1 source article · read the reporting →
Tesla Autopilot accidents and data leak suggest larger problems
Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →