Uber's Self-Driving Cars Ran Red Lights in San Francisco, Internal Documents Reveal
In late 2016, Uber's autonomous vehicles were recorded running red lights during a pilot program in San Francisco, endangering bicyclists. Uber publicly blamed human error and suspended a driver, but internal documents and employee statements indicated the cars were in autonomous mode at the time. The company declined to apply for a state testing permit, which would have required disengagement reports, and subsequently moved its self-driving operations to Arizona.
- Company involved
- Uber
9 source articles · read the reporting →
Cruise Recalls Self-Driving Software After San Francisco Crash Injures Two
In June 2022, a Cruise autonomous vehicle operating in San Francisco attempted an unprotected left turn and braked hard after incorrectly predicting an oncoming car would turn right. The other car continued straight and struck the Cruise vehicle, injuring a Cruise employee and a person in the other car. Cruise subsequently recalled the software on 80 vehicles, temporarily restricted left turns, and issued a software update to improve predictions. The US National Highway Traffic Safety Administration oversaw the recall.
- Company involved
- Cruise
7 source articles · read the reporting →
Waymo self-driving taxi blocks road after confusion with traffic cones
A Waymo self-driving taxi in Phoenix, Arizona, became confused by traffic cones closing a lane and stopped, blocking the road. The vehicle repeatedly drove away from roadside assistance dispatched to help, before a human driver took over. Waymo acknowledged the incident, stating that its remote guidance team provided incorrect instructions and that it has since improved its operational process. The passenger, who documented the event, said such mistakes are rare.
- Company involved
- Waymo
- AI system involved
- Waymo Driver
3 source articles · read the reporting →
McDonald's tests AI drive-thru ordering in Chicago
McDonald's is testing automated voice-ordering technology at ten drive-thru locations in Chicago. The system, developed by Apprente, uses artificial intelligence to take customer orders with about 85% accuracy, handling 80% of orders without human intervention. The company's CEO stated that wider implementation faces challenges such as menu and dialect variations. No incidents of harm were reported.
- Company involved
- McDonald's
3 source articles · read the reporting →
Tesla Full Self-Driving confused by truck carrying traffic lights
A Tesla vehicle using Full Self-Driving mode encountered a truck loaded with traffic lights. The system identified the traffic lights on the truck but was unable to determine the correct action, creating a confusing edge case. The incident was shared on social media, highlighting a limitation of the autonomous driving system.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
2 source articles · read the reporting →
Cruise autonomous vehicle briefly evades police traffic stop
On April 2, 2022, a driverless Cruise taxi in San Francisco was pulled over by police for driving without headlights. The vehicle initially drove away before stopping at a safe location, confusing officers. Cruise stated the car yielded as programmed and no citation was issued. The incident highlights challenges of autonomous vehicles interacting with law enforcement.
- Company involved
- Cruise
5 source articles · read the reporting →
Hackers trick Tesla Autopilot into veering into oncoming lane
Researchers at Tencent's Keen Security Lab demonstrated that stickers placed on a road could trick a Tesla Model S's Autopilot system into veering into the oncoming traffic lane. The attack exploited the system's reliance on camera-based computer vision to recognise lanes. Tesla responded that this vulnerability was unrealistic because a driver can easily override Autopilot, while saying a separate steering-wheel hijack had been fixed in a software update.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs
Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.
- AI system involved
- Mobileye ADAS
7 source articles · read the reporting →
Delphi denies near-miss between its self-driving car and Google's autonomous vehicle
Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.
- Company involved
- Delphi Automotive
- AI system involved
- Delphi self-driving car (Audi Q5 SUV)
7 source articles · read the reporting →
Tesla Autopilot tricked into speeding by electrical tape on sign
Researchers from McAfee Labs demonstrated that a two-inch piece of black electrical tape stuck on a 35 mph speed limit sign can cause the Traffic Aware Cruise Control in older Tesla Model S and X vehicles to misread the sign as 85 mph and automatically accelerate. The vulnerability affects vehicles using the MobilEye EyeQ3 camera system (Hardware Pack 1). The driver can override by braking. Tesla and MobilEye were informed but did not commit to fixing the issue.
- Company involved
- Tesla
- AI system involved
- Tesla Autopilot (Hardware Pack 1 with MobilEye EyeQ3)
8 source articles · read the reporting →
Tesla Autopilot stops for phantom stop sign on digital billboard
Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.
- Company involved
- Tesla
- AI system involved
- Tesla Autopilot
9 source articles · read the reporting →
NHTSA investigates Detroit Tesla crash that critically injured passenger
The National Highway Traffic Safety Administration is investigating a violent crash on March 11 in Detroit involving a Tesla sedan and a semi-truck. The car became wedged under the trailer, leaving a passenger in critical condition. Investigators have not yet determined whether Tesla's Autopilot, Full Self-Driving or FSD beta systems were engaged. The NHTSA has launched a Special Crash Investigation team to probe the incident.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles
The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.
- Company involved
- Tesla Inc.
- AI system involved
- Autopilot
10 source articles · read the reporting →
California threatens legal action against Uber over self-driving cars without permit
Uber launched a pilot program of self-driving taxis in San Francisco without obtaining a required permit from the California DMV. Two of the vehicles were observed running red lights on the first day. The California attorney general threatened legal action unless Uber removes the cars from the road. Uber argued that its cars are not fully autonomous and therefore not subject to the permit requirement.
- Company involved
- Uber
10 source articles · read the reporting →
Google self-driving car hits bus in first crash in which it was at fault
On 14 February 2016, a Google self-driving car sideswiped a public bus in Mountain View, California, in the first crash in which one of Google's autonomous vehicles was considered at fault. Google said the vehicle had tried to move around sandbags and struck the bus, and that the company bore some responsibility. No injuries were reported. Google said it had updated the vehicle's software to account for buses and other large vehicles.
- Company involved
- Google
10 source articles · read the reporting →
Answer.AI tests Devin and reports 14 failures in 20 tasks
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
- AI system involved
- Devin
5 source articles · read the reporting →
Cruise alleged to rely on human operators for autonomous driving
A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.
- Company involved
- Cruise
- AI system involved
- Cruise AV
9 source articles · read the reporting →
Study finds driverless car AI worse at detecting darker-skinned pedestrians
A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.
- AI system involved
- BDD100K
9 source articles · read the reporting →
Tesla's Full Self-Driving involved in fatal Bay Bridge crash
On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Waymo driverless car hits bicyclist in San Francisco intersection
On 6 February 2024, a Waymo driverless car collided with a bicyclist at a four-way intersection in San Francisco. The cyclist was obscured by a truck and the vehicle braked but could not stop in time. The cyclist sustained minor scratches and left the scene. Waymo stated it is contacting relevant authorities.
- Company involved
- Waymo
4 source articles · read the reporting →
Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck
司机依赖“智驾 ”跑高速，逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网
A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.
1 source article · read the reporting →
Tesla Autopilot accidents and data leak suggest larger problems
Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Waymo self-driving car hits child near Santa Monica school, US opens probe
A Waymo autonomous vehicle struck a child crossing the street near an elementary school in Santa Monica, California, on 23 January 2026, during school drop-off hours. The child sustained minor injuries. The US National Highway Traffic Safety Administration (NHTSA) and the National Transportation Safety Board (NTSB) have opened investigations into the incident. Waymo stated that the child emerged suddenly from behind a double-parked SUV and that the vehicle braked, reducing speed from 17 mph to under 6 mph before contact, and that a computer model suggested a human driver would have also hit the child.
- Company involved
- Waymo
- AI system involved
- Waymo
2 source articles · read the reporting →
Zoox recalls 332 robotaxis after self-driving cars veer into oncoming traffic
Zoox, Amazon's self-driving car company, recalled 332 robotaxis after they were found veering into oncoming traffic near intersections. The issue was first noticed in August 2025 when a car took a wide right turn crossing the center line. Zoox said no crashes or injuries occurred and fixed the problem with a software update. The National Highway Traffic Safety Administration confirmed the recall and is in ongoing discussions with Zoox.
- Company involved
- Zoox
- AI system involved
- Zoox robotaxis
6 source articles · read the reporting →
