The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

140 incidents closest to “Bosch ADAS integration platform” · matched on meaning · public reporting

Hackers trick Tesla Autopilot into veering into oncoming lane

Researchers at Tencent's Keen Security Lab demonstrated that stickers placed on a road could trick a Tesla Model S's Autopilot system into veering into the oncoming traffic lane. The attack exploited the system's reliance on camera-based computer vision to recognise lanes. Tesla responded that this vulnerability was unrealistic because a driver can easily override Autopilot, while saying a separate steering-wheel hijack had been fixed in a software update.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs

Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.

AI system involved
Mobileye ADAS

7 source articles · read the reporting →

WF-QWGD1Q25 Jun 2015

Delphi denies near-miss between its self-driving car and Google's autonomous vehicle

Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.

Company involved
Delphi Automotive
AI system involved
Delphi self-driving car (Audi Q5 SUV)

7 source articles · read the reporting →

WF-60D14K1 Nov 2018

EU to trial AI lie detector at airports in Hungary, Latvia, Greece

The European Union is set to trial an AI-powered lie detector system called iBorderCtrl at airports in Hungary, Latvia and Greece. The system uses a virtual avatar to question passengers and monitors their facial expressions to detect deception. Privacy groups have raised concerns about bias and error rates, noting that the technology has only been tested on 32 people. The trial will require passenger consent and will be overseen by human guards.

Company involved
European Union (iBorderCtrl project)
AI system involved
iBorderCtrl

6 source articles · read the reporting →

WF-ROSQWB1 Sep 2019

Tesla Autopilot tricked into speeding by electrical tape on sign

Researchers from McAfee Labs demonstrated that a two-inch piece of black electrical tape stuck on a 35 mph speed limit sign can cause the Traffic Aware Cruise Control in older Tesla Model S and X vehicles to misread the sign as 85 mph and automatically accelerate. The vulnerability affects vehicles using the MobilEye EyeQ3 camera system (Hardware Pack 1). The driver can override by braking. Tesla and MobilEye were informed but did not commit to fixing the issue.

Company involved
Tesla
AI system involved
Tesla Autopilot (Hardware Pack 1 with MobilEye EyeQ3)

8 source articles · read the reporting →

WF-KXXONZ1 Jan 2020

Tesla Autopilot stops for phantom stop sign on digital billboard

Researchers at Ben-Gurion University demonstrated that Tesla's Autopilot could be tricked into stopping for a split-second phantom stop sign displayed on a digital billboard. The system falsely detected the depthless object and applied the brakes in the middle of the road. The researchers disclosed their findings to Tesla and Mobileye. No actual accident occurred during the test.

Company involved
Tesla
AI system involved
Tesla Autopilot

9 source articles · read the reporting →

Kohler, BMW, MaxMara secretly collected customers' facial recognition data

During the 2021 CCTV 3·15 Gala, it was revealed that Kohler, BMW, and MaxMara stores had installed facial recognition cameras from vendors such as Wandianzhang and Youluoke. These cameras captured customers' facial data without their knowledge or consent, and the data was used to track customer visits and inform sales strategies. The systems were deployed in thousands of stores across China, collecting over 100 million facial records. The companies did not inform customers or obtain consent, violating Chinese privacy laws.

Company involved
Kohler (China) Investment Co., Ltd., ZhengTong Auto (BMW dealerships), MaxMara
AI system involved
Facial recognition cameras from Wandianzhang, Youluoke, Yaliang, Ruiwei

10 source articles · read the reporting →

NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles

The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.

Company involved
Tesla Inc.
AI system involved
Autopilot

10 source articles · read the reporting →

WF-FST9Z61 Apr 2018

ViaQuatro's facial recognition system in São Paulo metro challenged in court

In April 2018, ViaQuatro installed the Digital Interactive Doors System, developed by AdMobilize, on the São Paulo metro's yellow line. The system used cameras to detect passengers' faces and claimed to infer their emotion, age, and gender in order to target advertisements. The Brazilian Institute of Consumer Protection (IDEC) filed a public civil action alleging that the system violated consumer and data protection laws by processing biometric data without consent and making pseudoscientific and discriminatory inferences. A judge ordered the cameras removed in August 2018, and the case is pending a final ruling.

Company involved
ViaQuatro
AI system involved
Digital Interactive Doors System (DID system)

10 source articles · read the reporting →

WF-3G1L4Z14 Feb 2016

Google self-driving car hits bus in first crash in which it was at fault

On 14 February 2016, a Google self-driving car sideswiped a public bus in Mountain View, California, in the first crash in which one of Google's autonomous vehicles was considered at fault. Google said the vehicle had tried to move around sandbags and struck the bus, and that the company bore some responsibility. No injuries were reported. Google said it had updated the vehicle's software to account for buses and other large vehicles.

Company involved
Google

10 source articles · read the reporting →

WF-CQ2Y4G1 Jan 2019

Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade

In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.

Company involved
Ministry of Interior
AI system involved
Huawei smart surveillance cameras

10 source articles · read the reporting →

WF-HKRG5R7 Jul 2017

Hamburg deployed mass surveillance for G20 Summit

The city of Hamburg planned to use predictive policing software and facial recognition cameras for mass surveillance during the G20 Summit in July 2017. The surveillance was enforced by paramilitary means, creating a democracy-free zone. DiEM25 wrote an open letter to the Senate of Hamburg to protest the measures.

Company involved
Senate of Hamburg

10 source articles · read the reporting →

Drivers criticise new AI speed cameras for invading privacy

UK drivers are unhappy with new AI speed cameras that detect mobile phone use and seatbelt violations. The cameras, being piloted by National Highways and police forces, send images to police for action. Many drivers see them as an invasion of privacy, although some acknowledge safety benefits.

Company involved
National Highways

5 source articles · read the reporting →

Seoul Metropolitan Government rolls out AI CCTV cameras to prevent suicides

The Seoul Metropolitan Government has rolled out AI-enabled CCTV cameras on Han River bridges to identify people at risk of suicide. The system uses deep learning to analyse behavioural patterns and alerts rescue teams. Experts and Privacy International have raised concerns that it is invasive and could be misused because it captures biometric data without explicit consent. The article also considers whether such technology could be implemented in India.

Company involved
Seoul Metropolitan Government

8 source articles · read the reporting →

WF-MDLYYQ20 Aug 2024

Bengaluru AI traffic cameras wrongfully fine drivers due to seat belt confusion

Bengaluru's AI traffic cameras issued fines to drivers for not wearing seat belts even when they were properly secured. The system mistook a seat belt matching the driver's shirt colour for non-compliance. Similar issues have been reported in other Indian states. Authorities have added human oversight to review images before fines are finalized.

Company involved
Bengaluru Traffic Police

7 source articles · read the reporting →

Study finds driverless car AI worse at detecting darker-skinned pedestrians

A study by researchers from Georgia Tech found that facial recognition systems used in autonomous cars are up to 12% less accurate at detecting pedestrians with darker skin tones. The bias stems from a lack of diverse training data in the BDD100K database. The researchers warn that this could lead to higher accident rates for people with darker skin if not addressed.

AI system involved
BDD100K

9 source articles · read the reporting →

WF-K5NHEN24 Nov 2022

Tesla's Full Self-Driving involved in fatal Bay Bridge crash

On Thanksgiving 2022, a Tesla vehicle using its Full Self-Driving feature was involved in a fatal accident on the San Francisco Bay Bridge. Footage published by The Intercept showed the system braking abruptly. The incident highlights safety concerns with autonomous driving technology.

Company involved
Tesla
AI system involved
Full Self-Driving

7 source articles · read the reporting →

Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck

司机依赖“智驾 ”跑高速,逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网

A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.

1 source article · read the reporting →

Tesla Autopilot accidents and data leak suggest larger problems

Tesla is facing numerous lawsuits over its Autopilot driver assistance system, which has been involved in accidents. Internal data leaked to Handelsblatt suggests the company has larger technical problems than previously known. The US National Highway Traffic Safety Administration is investigating. Tesla has dismissed the data leak as theft.

Company involved
Tesla
AI system involved
Autopilot

9 source articles · read the reporting →

WF-KLSRXK24 Feb 2021

Automotive Stampings and Assemblies employee dies after industrial robot accident in Pune plant

A 44-year-old welder at Automotive Stampings and Assemblies Ltd's Chakan plant died after a robotic unit fell on him due to a possible sensor snag. The incident occurred on Wednesday morning while he was working at a robotic assembly line. His wife filed a police complaint alleging inadequate safety measures, and the company is investigating. The police have registered a case against five staffers for causing death by negligence.

Company involved
Automotive Stampings and Assemblies Ltd

1 source article · read the reporting →

WF-PQKZOM1 Jan 2016

Vumacam's AI CCTV system flagged 28 black people as suspicious in Johannesburg suburbs

In Johannesburg suburbs, Vumacam's AI-powered CCTV network using iSentry software flagged 28 black individuals as 'suspicious' in a shift report, according to a 2019 article. The system, deployed by private security firms, uses video analytics to detect abnormal behavior and alerts security guards. The article alleges that the system disproportionately targets people of color, reflecting racial bias in a racially divided country.

Company involved
Vumacam
AI system involved
iSentry

6 source articles · read the reporting →

WF-3Q7QY429 Jun 2015

Volkswagen robot kills contractor at German plant

A 22-year-old contractor was killed at a Volkswagen plant in Baunatal, Germany, when a stationary robot he was setting up grabbed and crushed him against a metal plate. Initial investigations suggest human error was to blame. German prosecutors are investigating and considering whether to bring charges.

Company involved
Volkswagen

10 source articles · read the reporting →

WF-DXNU9O1 Aug 2025

Zoox recalls 332 robotaxis after self-driving cars veer into oncoming traffic

Zoox, Amazon's self-driving car company, recalled 332 robotaxis after they were found veering into oncoming traffic near intersections. The issue was first noticed in August 2025 when a car took a wide right turn crossing the center line. Zoox said no crashes or injuries occurred and fixed the problem with a software update. The National Highway Traffic Safety Administration confirmed the recall and is in ongoing discussions with Zoox.

Company involved
Zoox
AI system involved
Zoox robotaxis

6 source articles · read the reporting →

WF-4NBY2U13 May 2024

NHTSA investigation PE24016: Unexpected ADS behavior

Waymo's automated driving system exhibited unexpected behavior during driving.

Company involved
Waymo

1 source article · read the reporting →

← Newerpage 5 of 6Older →