Where automated decisions went wrong

Uber set for €825mn Dutch fine over automating driver suspensions - Financial Times

The system automatically suspended Uber drivers.

Company involved

Uber

1 source article · read the reporting →

Assemblymember Kim Mi-ae: 11 Autonomous Vehicle ‘System Error’ Accidents, 4 Injured

김미애 의원, 자율주행자동차 ‘시스템 오류’ 사고 11건…4명 다쳐 - sisakoreanews.kr

Assemblymember Kim Mi-ae reported that there have been 11 accidents caused by system errors in autonomous vehicles. Four people were injured in these incidents.

1 source article · read the reporting →

Tesla Avoids Trial with Settlement Over Fatal Autopilot Crash

Tesla evita il processo con un accordo su un incidente mortale con Autopilot - Motori Magazine

Tesla reached a settlement with the family of a driver killed in a crash while Autopilot was active. The incident occurred in California when a Model S struck a diagonally parked fire truck. The case had raised questions about the system's reliability.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Tesla’s record month: 4 fatal Autopilot and Full Self-Driving crashes - Electrek

Vehicle steering, acceleration, and braking were controlled by the system during crashes resulting in fatalities.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Tesla's FSD reportedly engaged during fatal Illinois crash -- Electrek (TSLA:NASDAQ) - Seeking Alpha

Vehicle control and navigation decisions affecting a driver and potentially other road users

Company involved

Tesla

AI system involved

FSD

1 source article · read the reporting →

Apple, Amazon, Meta, Microsoft, Nvidia, and Samsung face class action suits over AI voice training - cryptobriefing.com

The AI voice models were trained on the plaintiffs' voice recordings without their consent.

Company involved

Apple, Amazon, Meta, Microsoft, Nvidia, Samsung, Alphabet, Adobe, ElevenLabs

1 source article · read the reporting →

CVS settles lawsuit alleging it used AI 'lie detector' in interviews

CVS reached a tentative settlement of a proposed class action by a Massachusetts job applicant who said his 2021 HireVue video interview was analysed with Affectiva's AI to track facial expressions without notice, amounting to a lie detector test banned by state law. He could not opt out or challenge the assessment, and was not hired.

Company involved

CVS Health

AI system involved

HireVue video interview with Affectiva analysis

1 source article · read the reporting →

Pony.ai Recalls Autonomous Driving Software After California Crash

In October 2021, a Pony.ai autonomous vehicle without a human safety driver collided with a lane divider and street sign in Fremont, California. No injuries occurred, but the incident led the California DMV to suspend Pony.ai's driverless testing permit and prompted an NHTSA inquiry. The agency determined a software defect caused the crash and requested a recall, which Pony.ai issued for three vehicles in March 2022. The company updated its software and repaired the affected vehicles, while the driverless permit remains suspended pending DMV verification.

Company involved

Pony.ai

10 source articles · read the reporting →

Aftermarket driver assist under federal probe following fatal crashes - Ars Technica

The comma.ai driver assist system failed to detect slow or stopped vehicles, causing crashes that killed three people and injured 11.

AI system involved

openpilot

1 source article · read the reporting →

SiriusXM Radio faces class action on AI discrimination

The AI hiring tool screened and rejected job applicants, including the plaintiff, based on race-related data points.

Company involved

SiriusXM Radio

AI system involved

iCims

1 source article · read the reporting →

Tesla Autopilot Fatal Crash Compensation Set at $243 Million — How Ad Language Redefines Automotive Liability

테슬라 오토파일럿 사망사고 배상 2,430억 원 확정 — 광고 문구가 바꿀 자동차 책임의 경계 - 얼리어답터뉴스

A U.S. federal court finalized $243 million in damages against Tesla for a 2019 fatal crash involving Autopilot. The jury found Tesla's marketing language misled consumers about the system's capabilities, assigning the company 33% of the blame and imposing $200 million in punitive damages.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Driver at Fault in Driver-Assist Crash Seeks Compensation; Li Auto Rejects Full Payout

开辅助驾驶撞车全责车主索赔 理想回应拒绝全额赔偿 - 中华网

A Li Auto owner crashed into an oncoming vehicle while using driver-assist on a downhill curve, and police assigned full liability. The owner demanded a car refund then 50,000 yuan for losses, but Li Auto offered only about 18,000 yuan for direct accident expenses, maintaining that drivers must remain attentive and ready to take over.

Company involved

Li Auto

AI system involved

Li Auto assisted driving

1 source article · read the reporting →

Fatal Tesla Crash: Company Confirms Autopilot/FSD Were Active

Incidente mortale in Tesla, l'azienda: "Autopilot/FSD attivi". È stata colpa dell'auto? - Everyeye Auto

Tesla confirmed to NHTSA that driver-assistance systems were engaged during a fatal crash in Texas in May 2026. The vehicle was traveling at approximately 167 km/h on an urban road. Police consider a medical emergency the most likely cause.

Company involved

Tesla

AI system involved

Autopilot/FSD

1 source article · read the reporting →

EE.UU. investiga a comma.ai tras cinco accidentes con openpilot y tres muertos - Somos Eléctricos

The system controlled the vehicle's steering, acceleration, and braking, and failed to avoid collisions with stopped or slow-moving vehicles, resulting in accidents and fatalities.

Company involved

comma.ai

AI system involved

openpilot (comma three, 3X, comma four)

1 source article · read the reporting →

11 Crashes from 'System Errors' in Pilot Self-Driving Cars; Investigations Lag, Cause Classification Inadequate

시범 자율주행차 '시스템 오류' 사고 11건…조사는 '늑장' 원인 분류도 '부실' - v.daum.net

Between 2023 and 2025, 11 traffic accidents were caused by autonomous driving system errors in vehicles with temporary operation permits, resulting in four minor injuries. In the first half of this year alone, 27 accidents occurred, but only two have had their causes confirmed, while the remaining 25 are still under investigation. The Korea Transportation Safety Authority has not disclosed company-specific accident details, citing trade secrets, and uses only broad categories for causes.

1 source article · read the reporting →

Ladbrokes App Official Site: Tesla Autopilot in Another Fatal Crash, Regulators Order Full Investigation - PChome

立博app官方网站特斯拉自动驾驶再出致命事故，监管部门下令全面排查 - Pchome电脑之家

Tesla's Autopilot system was involved in another fatal accident. Regulatory authorities have ordered a comprehensive investigation into the incident.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Tesla recalls 11,704 vehicles over Full Self-Driving Beta software error

Tesla voluntarily recalled 11,704 vehicles after identifying a software error in its Full Self-Driving Beta system that could cause false forward-collision warnings or unexpected automatic emergency braking. The error, a communication disconnect between two on-board chips, was introduced in an over-the-air update on October 23, 2021. Tesla stated it was not aware of any crashes or injuries and issued a software fix. The National Highway Traffic Safety Administration (NHTSA) is monitoring the situation.

Company involved

Tesla

AI system involved

Full Self-Driving Beta

10 source articles · read the reporting →

Zoox Recalls 105 Robotaxis After Vehicle Enters Fire Scene in Las Vegas

A Zoox autonomous vehicle drove into heavy smoke at an active fire scene in Las Vegas on June 20, 2026, before emergency crews had fully secured the area. The unoccupied robotaxi braked and stopped, then reversed out under remote operator guidance. Zoox issued a voluntary recall of its 105-vehicle fleet and deployed a software update to improve smoke detection. The incident has drawn scrutiny from NHTSA, which plans to meet with autonomous vehicle developers to address such safety issues.

Company involved

Zoox

AI system involved

Zoox autonomous driving software

2 source articles · read the reporting →

SEC Charges Delphia and Global Predictions for False AI Claims

The SEC charged Delphia (USA) Inc. and Global Predictions Inc. for making false and misleading statements about their use of artificial intelligence. Delphia claimed from 2019 to 2023 that it used AI and machine learning to predict investments, while Global Predictions falsely claimed in 2023 to be the 'first regulated AI financial advisor'. Both firms settled the charges without admitting or denying the findings, agreeing to pay a total of $400,000 in civil penalties and to cease and desist from further violations.

Company involved

Delphia (USA) Inc. and Global Predictions Inc.

1 source article · read the reporting →

Zoox Recalls Software After Autonomous Vehicles Cross Lane Lines

Zoox issued a voluntary software recall for 332 autonomous vehicles after identifying instances where the vehicles crossed center lane lines or blocked crosswalks. The issue, first observed on August 26, 2025, involved a robotaxi making a wide turn into an opposing lane. No collisions occurred, but the company acknowledged the risk and deployed software updates in November and December to correct the behavior. Zoox is in ongoing discussions with NHTSA about the incidents.

Company involved

Zoox

AI system involved

Zoox autonomous driving system

2 source articles · read the reporting →

Volkswagen Settles Class Action Over Front Assist Automatic Braking Defects

A class action lawsuit alleged that Volkswagen and Audi vehicles equipped with automatic emergency braking systems, including Volkswagen's Front Assist, can mistakenly activate sudden braking while driving, posing a safety hazard. The lawsuit, consolidated from four class actions, claimed the systems were defective. Volkswagen denied the claims but reached a settlement in January 2024, providing an extended warranty, partial reimbursement for past repairs, and additional information on system limitations. The settlement was filed in the U.S. District Court for the Western District of Missouri.

Company involved

Volkswagen Group of America, Inc.

AI system involved

Front Assist, Audi Braking Guard, Pre Sense Front, Audi Pre Sense City, Turn assist

2 source articles · read the reporting →

Arity collected drivers' data via apps for insurance scores

Popular smartphone apps including Life360, MyRadar and GasBuddy reportedly shared users' location and motion data with Arity, an Allstate-owned company. Arity used the data to calculate driving scores that could be sold to car insurers to set rates. Users were said not to be clearly informed that their data would be used for insurance pricing. Life360 and Arity stated that users had to opt in and that no personally identifiable driving data was shared without consent.

Company involved

Arity

AI system involved

Arity IQ network

2 source articles · read the reporting →

Xpeng Motors Fined for Collecting Customer Facial Images Without Consent

Xpeng Motors was fined 100,000 yuan by Shanghai's market regulation authority for collecting 431,623 facial images of customers without consent. The company used surveillance cameras with facial recognition from a third-party supplier, Ulucu, to analyze customer traffic. Xpeng stated it removed the devices and deleted all data before the inspection, and that no data was leaked or misused.

Company involved

Xpeng Motors

4 source articles · read the reporting →

Volvo self-driving car blinded by snow in Sweden test

During testing in Jokkmokk, Sweden, a Volvo self-driving XC90 SUV's radar sensors became caked with frozen flakes, rendering the vehicle unable to read the road. The incident highlighted the challenge of snow blindness for autonomous vehicles. Ford engineers later proposed a solution using lidar to create high-definition 3-D maps.

Company involved

Volvo Cars

AI system involved

self-driving XC90 SUV

4 source articles · read the reporting →