Tesla Recalls 360,000 Vehicles with Full Self-Driving Beta Over Crash Risk
Tesla is recalling more than 360,000 vehicles equipped with its Full Self-Driving Beta software after a government regulator found that the cars could proceed through intersections without stopping, posing a crash risk. The company said it would issue a remote software update to remedy the problem. The recall is a significant setback for Tesla's autonomous driving ambitions.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving Beta
10 source articles · read the reporting →
Ningbo police AI falsely accuses woman in bus ad of jaywalking
An AI jaywalking detection system used by police in Ningbo, China, mistakenly identified a photograph of Dong Mingzhu, head of Gree Electric, on a bus advertisement as a real person jaywalking. Her image and name were briefly displayed on a public shaming billboard. Police acknowledged the error, deleted the photo, and stated they would update the system to distinguish advertisements from people. Gree Electric thanked the police for their response.
- Company involved
- Ningbo police
10 source articles · read the reporting →
Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops
Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving (FSD) beta
5 source articles · read the reporting →
Cruise Recalls Self-Driving Software After San Francisco Crash Injures Two
In June 2022, a Cruise autonomous vehicle operating in San Francisco attempted an unprotected left turn and braked hard after incorrectly predicting an oncoming car would turn right. The other car continued straight and struck the Cruise vehicle, injuring a Cruise employee and a person in the other car. Cruise subsequently recalled the software on 80 vehicles, temporarily restricted left turns, and issued a software update to improve predictions. The US National Highway Traffic Safety Administration oversaw the recall.
- Company involved
- Cruise
7 source articles · read the reporting →
Tesla Full Self-Driving confused by truck carrying traffic lights
A Tesla vehicle using Full Self-Driving mode encountered a truck loaded with traffic lights. The system identified the traffic lights on the truck but was unable to determine the correct action, creating a confusing edge case. The incident was shared on social media, highlighting a limitation of the autonomous driving system.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
2 source articles · read the reporting →
Cruise autonomous vehicle briefly evades police traffic stop
On April 2, 2022, a driverless Cruise taxi in San Francisco was pulled over by police for driving without headlights. The vehicle initially drove away before stopping at a safe location, confusing officers. Cruise stated the car yielded as programmed and no citation was issued. The incident highlights challenges of autonomous vehicles interacting with law enforcement.
- Company involved
- Cruise
5 source articles · read the reporting →
Facial recognition pilot at Berlin-Südkreuz by German police
A year-long pilot project of facial recognition technology was carried out at Berlin-Südkreuz train station from August 2017 to July 2018. The project was initiated by the German Ministry of the Interior, federal and state police, and supported by Deutsche Bahn. The pilot became a catalyst for media attention, spurring discourse on the efficiency and legitimacy of surveillance technology.
- Company involved
- German Federal Police
10 source articles · read the reporting →
Hackers trick Tesla Autopilot into veering into oncoming lane
Researchers at Tencent's Keen Security Lab demonstrated that stickers placed on a road could trick a Tesla Model S's Autopilot system into veering into the oncoming traffic lane. The attack exploited the system's reliance on camera-based computer vision to recognise lanes. Tesla responded that this vulnerability was unrealistic because a driver can easily override Autopilot, while saying a separate steering-wheel hijack had been fixed in a software update.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs
Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.
- AI system involved
- Mobileye ADAS
7 source articles · read the reporting →
Delphi denies near-miss between its self-driving car and Google's autonomous vehicle
Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.
- Company involved
- Delphi Automotive
- AI system involved
- Delphi self-driving car (Audi Q5 SUV)
7 source articles · read the reporting →
Tesla Autopilot stops for phantom stop sign on digital billboard
Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.
- Company involved
- Tesla
- AI system involved
- Tesla Autopilot
9 source articles · read the reporting →
NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles
The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.
- Company involved
- Tesla Inc.
- AI system involved
- Autopilot
10 source articles · read the reporting →
ViaQuatro's facial recognition system in São Paulo metro challenged in court
In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.
- Company involved
- ViaQuatro
- AI system involved
- Digital Interactive Doors System (DID system)
10 source articles · read the reporting →
Google self-driving car hits bus in first crash in which it was at fault
On 14 February 2016, a Google self-driving car sideswiped a public bus in Mountain View, California, in the first crash in which one of Google's autonomous vehicles was considered at fault. Google said the vehicle had tried to move around sandbags and struck the bus, and that the company bore some responsibility. No injuries were reported. Google said it had updated the vehicle's software to account for buses and other large vehicles.
- Company involved
- Google
10 source articles · read the reporting →
Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade
In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.
- Company involved
- Ministry of Interior
- AI system involved
- Huawei smart surveillance cameras
10 source articles · read the reporting →
Hamburg deployed mass surveillance for G20 Summit
The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.
- Company involved
- Senate of Hamburg
10 source articles · read the reporting →
Drivers criticise new AI speed cameras for invading privacy
UK drivers are unhappy with new AI speed cameras that detect mobile phone use and seatbelt violations. The cameras, being piloted by National Highways and police forces, send images to police for action. Many drivers see them as an invasion of privacy, although some acknowledge safety benefits.
- Company involved
- National Highways
5 source articles · read the reporting →
Seoul Metropolitan Government rolls out AI CCTV cameras to prevent suicides
The Seoul Metropolitan Government has rolled out AI-enabled CCTV cameras on Han River bridges to identify people at risk of suicide. The system uses deep learning to analyse behavioural patterns and alerts rescue teams. Experts and Privacy International have raised concerns that it is invasive and could be misused because it captures biometric data without explicit consent. The article also considers whether such technology could be implemented in India.
- Company involved
- Seoul Metropolitan Government
8 source articles · read the reporting →
Bengaluru AI traffic cameras wrongfully fine drivers due to seat belt confusion
Bengaluru's AI traffic cameras issued fines to drivers for not wearing seat belts even when they were properly secured. The system mistook a seat belt matching the driver's shirt colour for non-compliance. Similar issues have been reported in other Indian states. Authorities have added human oversight to review images before fines are finalized.
- Company involved
- Bengaluru Traffic Police
7 source articles · read the reporting →
Study finds driverless car AI worse at detecting darker-skinned pedestrians
A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.
- AI system involved
- BDD100K
9 source articles · read the reporting →
Tesla's Full Self-Driving involved in fatal Bay Bridge crash
On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck
司机依赖“智驾 ”跑高速，逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网
A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.
1 source article · read the reporting →
Tesla Autopilot accidents and data leak suggest larger problems
Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Automotive Stampings and Assemblies employee dies after industrial robot accident in Pune plant
A 44-year-old welder at Automotive Stampings and Assemblies Ltd's Chakan plant died after a robotic unit fell on him due to a possible sensor snag. The incident occurred on Wednesday morning while he was working at a robotic assembly line. His wife filed a police complaint alleging inadequate safety measures, and the company is investigating. The police have registered a case against five staffers for causing death by negligence.
- Company involved
- Automotive Stampings and Assemblies Ltd
1 source article · read the reporting →
