Where automated decisions went wrong

NHTSA investigation PE24016: Unexpected ADS behavior

Waymo's automated driving system exhibited unexpected behavior during driving.

Company involved

Waymo

1 source article · read the reporting →

Tesla Cybertruck owner sues over FSD crash in Houston overpass

Justine Saint Amour is suing Tesla after her Cybertruck, with Full Self-Driving engaged, crashed into a concrete barrier on a Houston overpass on August 18, 2025. The lawsuit alleges that Tesla was negligent in hiring and retaining Elon Musk as CEO, and that the FSD system was defective due to lack of LiDAR and ineffective automatic emergency braking. Saint Amour seeks over $1 million in damages.

Company involved

Tesla

AI system involved

Full Self-Driving (FSD)

3 source articles · read the reporting →

Durham's ShotSpotter fails to detect two deadly shootings

ShotSpotter, a gunshot detection system piloted by the Durham Police Department, failed to detect two fatal shootings in February 2023, as well as a New Year's Day shooting that injured five. The system, which uses sensors and human review to alert police, did not send alerts for these incidents within its three-square-mile coverage area. The company stated it investigated and provided a report to the police, while a city official defended the pilot, noting it is still early in the year-long trial. Community concerns have been raised about increased police presence and potential racial profiling.

Company involved

Durham Police Department

AI system involved

ShotSpotter

5 source articles · read the reporting →

TransUnion AI tenant screening denied 75-year-old man apartment due to mistaken littering conviction

Chris Robinson, then 75, applied for a senior living apartment in California. The property manager used an AI screening program from TransUnion, which assigned him a low score based on a mistaken conviction for littering that belonged to a different person with the same name in Texas. Robinson lost the apartment and his application fee. A federal class-action lawsuit against TransUnion moved toward a $11.5 million settlement in 2023.

10 source articles · read the reporting →

Security Health Plan used AI to cut off nursing home care for 85-year-old woman

Frances Walter, an 85-year-old woman with a shattered shoulder, had her nursing home care payment cut off by Security Health Plan after an algorithm predicted she would recover in 16.6 days. The algorithm, nH Predict from NaviHealth, did not account for her severe pain and allergy to pain medicine. She was forced to spend her life savings and enroll in Medicaid while fighting the denial. A federal judge later ruled the denial was speculative and she was owed thousands of dollars.

Company involved

Security Health Plan

AI system involved

nH Predict

1 source article · read the reporting →

Boeing ordered to pay $49.5 million to family of 737 MAX crash victim

A federal jury in Chicago awarded $49.5 million to the family of Samya Stumo, who died in the 2019 crash of Ethiopian Airlines Flight 302, a Boeing 737 MAX. The crash was caused by a problem with the plane's automated flight control system. Boeing admitted responsibility, and the trial determined compensatory damages for the family's loss. The family has also pushed for accountability from regulators.

Company involved

Boeing

AI system involved

737 MAX

10 source articles · read the reporting →

Snapchat not liable for Quick Add connecting 12-year-old to sex offenders

A 12-year-old girl was sexually assaulted after Snapchat's Quick Add feature recommended she connect with convicted sex offenders. Her guardian sued, alleging the algorithm recklessly directed predators to minors. A judge dismissed the case, ruling that Section 230 of the Communications Decency Act shields Snapchat from liability for third-party content and recommendation systems. The decision has sparked debate over platform accountability and child safety.

Company involved

Snapchat

AI system involved

Quick Add

1 source article · read the reporting →

Insurer drops California homeowner after aerial photo analysis

Cindy Picos was dropped by her home insurer after the company used aerial photos to assess her roof. The insurer refused to let her see the photos, and she believes her roof is in fine shape. The incident highlights the growing use of drones and aerial imagery by insurers to inspect properties without in-person visits.

2 source articles · read the reporting →

Tesla Model 3 crash, 1 killed, Autopilot verified: Tesla falls from height

The vehicle drove off the road and fell from a height, killing the driver.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Zillow faces securities class action over Zillow Offers wind-down

Zillow Group, Inc. is accused of making false and misleading statements to investors about its Zillow Offers home-flipping business. The company allegedly failed to disclose that its forecasting algorithm was unable to predict home prices accurately, leading to a $304 million inventory write-down and a decision to wind down the business. Investors who bought shares between February 10 and November 2, 2021, suffered losses when the stock price dropped after the announcement. A class action lawsuit has been filed in Washington federal court.

Company involved

Zillow Group, Inc.

AI system involved

Zillow Offers

10 source articles · read the reporting →

Beep automated bus rear-ended by Tesla in Washington D.C.

An automated bus operated by Beep was rear-ended by a Tesla driver making an illegal lane change in Washington D.C. on 18 January 2026. The bus, part of a pilot programme with the U.S. Department of Transportation, had a human backup driver and sustained minor cosmetic damage. Service was temporarily paused but resumed after a review found the bus operated appropriately. No police were called and the incident was not reported to NHTSA as the damage was under $1,000 and the other driver was at fault.

Company involved

Beep

AI system involved

Beep automated bus

2 source articles · read the reporting →

Tesla Model S crash, 2 killed, Autopilot verified: Tesla hits parked tractor-trailer

The Tesla Autopilot system failed to detect a parked tractor-trailer, causing a collision that killed two occupants.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Steak 'n Shake sued over facial recognition kiosks under BIPA

A class action lawsuit alleges that Steak 'n Shake illegally collects facial biometrics from customers using PopID-powered self-ordering kiosks without proper consent. Plaintiff Michael Massel claims the restaurant chain failed to provide notice and obtain written consent as required by Illinois' Biometric Information Privacy Act (BIPA). The suit seeks damages of up to $5,000 per violation for anyone whose biometric data was collected in Illinois in the past five years.

Company involved

Steak 'n Shake

AI system involved

PopID biometric kiosks

6 source articles · read the reporting →

Waymo Self-Driving Taxis Crash into Backwards-Towed Pickup in Phoenix

On 11 December 2023, two Waymo autonomous vehicles collided with a pickup truck being towed backwards in Phoenix, Arizona. The vehicles were operating without passengers and sustained minor damage, with no injuries reported. Waymo attributed the crashes to a software error that mispredicted the towed vehicle's motion and subsequently deployed a fix. The company filed a voluntary recall report with the NHTSA.

Company involved

Waymo

AI system involved

Waymo Driver

3 source articles · read the reporting →

Lawsuit says Tesla Autopilot missed a curve before a fatal Model X crash

The Autopilot system missed a curve, causing a fatal crash for the driver.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

State Farm accused of algorithmic bias against Black homeowners

A class action lawsuit filed in Chicago alleges State Farm's automated claims processing system discriminates against Black policyholders. The suit claims Black customers are more likely to face additional paperwork and longer waits for claim approval than white customers, citing data from 800 homeowners. State Farm has stated it takes the filing seriously and is committed to fair treatment, while the plaintiffs seek to enjoin the current system and require audits.

Company involved

State Farm

AI system involved

automated claims processing system

2 source articles · read the reporting →

Tesla sued by family of Jeremy Beren Banner over fatal Autopilot crash

The family of Jeremy Beren Banner is suing Tesla for wrongful death after his Model 3 crashed into a tractor-trailer while Autopilot was engaged. Banner, 50, died when the car collided at 68 mph and its roof was torn off. Tesla claims Banner removed his hands from the wheel immediately after activating Autopilot, but the family's lawyer disputes this. The lawsuit alleges the car was defective and that Tesla's sales language overpromises self-driving capability.

Company involved

Tesla

AI system involved

Autopilot

4 source articles · read the reporting →

NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged

The system made driving decisions that violated traffic safety laws, affecting other road users.

Company involved

Tesla, Inc.

AI system involved

Full Self Driving (FSD)

1 source article · read the reporting →

Sibuxiang Genuine + Genuine Sibuxiang: Tesla Autopilot in Another Accident, Owner Says System Failed to Recognize Construction Barriers, Causing Rear-End…

四不像正版+正版四不像特斯拉自动驾驶再出事故，车主称系统未识别施工路障致追尾 - Pchome电脑之家

A Tesla owner reported that the vehicle's Autopilot system did not detect construction barriers, leading to a rear-end collision. The incident was reported by Pchome.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles

Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users

Company involved

Zoox

AI system involved

Zoox vehicle

1 source article · read the reporting →

Tesla Model 3 crash, 1 killed, Autopilot verified: Multi-event collision with truck on highway

The Tesla Model 3, with Autopilot possibly engaged, struck an overturned semi-truck and a pedestrian, killing the driver and injuring the pedestrian.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Whiteside County sergeant misused license plate reader data, resigned; state police reviewing case: Sheriff - Shaw Local

The system collected license plate data on vehicles, and the sergeant accessed it without a legitimate law enforcement purpose.

Company involved

Flock Safety

AI system involved

Flock Safety ALPR

1 source article · read the reporting →

Tesla Lawsuit Claims Autopilot Accelerated So Violently the Tires Burst - Autoblog

The vehicle accelerated violently, causing the tires to burst, affecting the driver.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Bengaluru woman loses Rs 3.75 crore in Sadhguru deepfake investment scam

A 57-year-old retired woman in Bengaluru was defrauded of Rs 3.75 crore after scammers used an AI-generated deepfake video of spiritual leader Sadhguru Jaggi Vasudev to promote a fake investment platform called Mirrox. Between February and April 2025, she transferred the money across multiple transactions after being added to a WhatsApp group where fabricated profits were shared to build trust. She realised the fraud when she attempted to withdraw funds and the scammers demanded additional fees, then ceased communication. Police are coordinating with banks to freeze the fraudsters' accounts, but recovery is expected to be challenging.

Company involved

Mirrox

AI system involved

Mirrox stock trading app

2 source articles · read the reporting →