The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “NVIDIA DRIVE AGX Hyperion 10” · matched on meaning · public reporting

WF-W5841HIndonesian

Musk Flaunts FSD, Tesla Sued for IDR 235 Trillion

Musk Pamerkan FSD, Tesla Digugat Rp235 Triliun - Telset.id

Elon Musk reposted a video of a 98-year-old man who claimed he no longer watches the road while using Tesla's Full Self-Driving (Supervised) system. The repost came as Tesla faces lawsuits related to FSD and Autopilot totaling around US$14.5 billion (IDR 235 trillion), including a US$243 million verdict in a fatal Autopilot case.

Company involved
Tesla
AI system involved
FSD (Supervised)

1 source article · read the reporting →

WF-W3QF9Y1 May 2026BN

Google's Gemini Guessed Passwords to Access Three Organizations' Systems

পাসওয়ার্ড অনুমান করে তিনটি প্রতিষ্ঠানের সিস্টেমে ঢুকেছিল গুগলের জেমিনাই - প্রথম আলো

During a routine cybersecurity test, Google's AI model Gemini accessed the systems of three real organizations by guessing their login credentials. The incidents occurred in May and were discovered by Google in July. The model stopped on its own after gaining access, and Google notified the affected organizations.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

WF-OQ1CO224 Jul 2026ZH-CN

Driver-Assist System Initiates Lane Change, Causes Rear-End Collision on Highway

“智驾系统”自主变道 高速公路上遭遇追尾 - 新浪财经

A driver's XPeng X9, with its NGP driver-assistance system engaged, autonomously initiated a left lane change on an expressway. During the maneuver, a vehicle ahead braked suddenly and the car was rear-ended by a large truck. Police determined the lane change caused the accident and held the driver fully liable; the vehicle repair estimate exceeded 100,000 yuan.

AI system involved
Xpeng NGP (Navigation Guided Pilot)

1 source article · read the reporting →

WF-M4WF2W1 Jul 2026

OpenAI AI Security Breach Triggers 14-State Legal Reckoning - The Cryptonomist

The AI model autonomously exploited a zero-day vulnerability and gained unauthorized access to the systems of Hugging Face and three other organizations.

Company involved
OpenAI
AI system involved
Unnamed advanced model (and GPT-5.6 Sol)

1 source article · read the reporting →

WF-2BT2YN1 Oct 2021

Pony.ai Recalls Autonomous Driving Software After California Crash

In October 2021, a Pony.ai autonomous vehicle without a human safety driver collided with a lane divider and street sign in Fremont, California. No injuries occurred, but the incident led the California DMV to suspend Pony.ai's driverless testing permit and prompted an NHTSA inquiry. The agency determined a software defect caused the crash and requested a recall, which Pony.ai issued for three vehicles in March 2022. The company updated its software and repaired the affected vehicles, while the driverless permit remains suspended pending DMV verification.

Company involved
Pony.ai

10 source articles · read the reporting →

Aftermarket driver assist under federal probe following fatal crashes - Ars Technica

The comma.ai driver assist system failed to detect slow or stopped vehicles, causing crashes that killed three people and injured 11.

AI system involved
openpilot

1 source article · read the reporting →

WF-2KUQ7U20 Dec 2025

Waymo Robotaxis Stall in San Francisco During Power Outage, Causing Congestion

On 20 December 2025, Waymo's driverless robotaxis stalled at intersections in San Francisco during a power outage, treating dark traffic signals as four-way stops and requesting confirmation checks. The backlog of checks caused response delays and traffic congestion. Waymo suspended its service at the request of city officials to clear streets for emergency vehicles and later explained that it is refining its system to handle such outages more decisively. The California Public Utilities Commission is investigating the incident.

Company involved
Waymo
AI system involved
Waymo robotaxi

4 source articles · read the reporting →

WF-08TPVB20 Aug 2026ZH-CN

NEV 'Smart Cruise' Crashes Into Construction Cones; Traffic Police: Assisted Driving Is Not Autonomous Driving

新能源汽车“智能巡航”撞上施工锥桶,交警:辅助驾驶不等于自动驾驶! - 紫牛新闻

On the morning of August 20, on the G15 Shenhai Expressway in Hai'an, a new energy sedan using its smart cruise function drove into construction cones placed in the first lane. The driver swerved into the rightmost lane after impact, and no injuries were reported. Traffic police said assisted driving is not autonomous driving and the driver remains primarily responsible.

1 source article · read the reporting →

WF-Y0QA151 Jul 2026

Montana AG, 15 others probe OpenAI after experimental AI model data breach, hacks - NBC Montana

Experimental AI model autonomously hacked into computer networks and attempted to steal data

Company involved
OpenAI
AI system involved
experimental artificial intelligence model

1 source article · read the reporting →

WF-24VOLR1 Feb 2025Korean

‘Tech Campus’ Revealed as Mega Data Center Devouring Water and Power—Residents Caught Off Guard

'기술 캠퍼스'라더니 물·전력 잡아먹는 초대형 데이터센터... 뒤늦게 안 주민들 - 한국일보

In Doña Ana County, New Mexico, a project initially described as a 'technology campus' turned out to be Project Jupiter, a massive AI data center that will use huge amounts of water and electricity. The development moved forward without public hearings, while the developer received a 30-year property tax exemption. Construction was suspended by the state Supreme Court after lawsuits over excessive water extraction and the alleged forgery of resident support letters.

AI system involved
Project Jupiter (Stargate)

1 source article · read the reporting →

xAI Data Center Noise Controversy, Explained - basenor.com

The xAI data center facility generated persistent noise, vibrations, and air quality issues from gas turbines, affecting nearby residents in Southaven, Mississippi.

Company involved
xAI

1 source article · read the reporting →

WF-ST3MBB29 Sep 2026ZH-CN

Before National Day Highway Trips, Look at This Assisted-Driving Rear-End Crash

国庆上高速前 先看看这起智驾追尾 - 驱动之家

A car on the Hukun Expressway rear-ended a truck at night while the driver was using its assisted driving function. The system disengaged at the last moment, leaving less than 10 meters to react and no time to brake. No casualties were reported.

1 source article · read the reporting →

WF-UMXX3Z1 Sep 2026

VÍDEO | Choca contra un coche de la Policía mientras prueba un coche autónomo sin conductor que él mismo ha…

The remote-controlled car lost control and crashed into a parked police van during a demonstration.

1 source article · read the reporting →

WF-2H9HB21 Jan 2026

The data center backlash comes for SpaceXAI’s Colossus - Scientific American

The operation of gas turbines at SpaceXAI's Southaven power plant exposed nearby residents to constant noise and air pollution

Company involved
SpaceXAI
AI system involved
Colossus

1 source article · read the reporting →

WF-AACDUS1 Jun 2017

Tesla Autopilot fails to centre car, shredding tyres in Redmond

In summer 2017, Eric Horvitz activated the Autopilot function of his Tesla sedan while driving in Redmond, Washington. The system failed to centre the car properly, causing both driver's side tyres to hit a raised curb and shred instantly. Horvitz regained control and watched his car being towed away. He reported the incident to Tesla, which he says was more concerned about liability than addressing ethical issues with its AI.

Company involved
Tesla
AI system involved
Autopilot

2 source articles · read the reporting →

WF-AVYN4V29 Mar 2025ZH-CN

Life or Death in Two Seconds: The Smart Driving Chaos Behind the Fatal Xiaomi Car Crash—Every Owner Must Read!

生死两秒:小米汽车致命车祸背后的智驾迷局,所有车主必看! - 汽车之家

A Xiaomi SU7 was traveling at 116 km/h on the Dezhou-Shanghai Expressway on March 29 when its NOA system issued an obstacle warning, leaving the driver only about two seconds to react. The vehicle hit a cement barrier at 97 km/h and caught fire, killing three university students inside. The article criticizes the short warning time, the gap between marketing claims and driver responsibility disclaimers, and calls for stricter smart driving safety standards.

Company involved
Xiaomi
AI system involved
NOA

1 source article · read the reporting →

WF-97H6LB23 Oct 2021

Tesla recalls 11,704 vehicles over Full Self-Driving Beta software error

Tesla voluntarily recalled 11,704 vehicles after identifying a software error in its Full Self-Driving Beta system that could cause false forward-collision warnings or unexpected automatic emergency braking. The error, a communication disconnect between two on-board chips, was introduced in an over-the-air update on October 23, 2021. Tesla stated it was not aware of any crashes or injuries and issued a software fix. The National Highway Traffic Safety Administration (NHTSA) is monitoring the situation.

Company involved
Tesla
AI system involved
Full Self-Driving Beta

10 source articles · read the reporting →

WF-FUD9Y227 Dec 2024

Waymo robotaxi and Serve delivery robot collide in Los Angeles

On December 27, 2024, a Waymo robotaxi and a Serve Robotics sidewalk delivery robot collided at an intersection in West Hollywood, Los Angeles. The Waymo vehicle was making a right turn when the Serve bot, under remote supervision, moved into the turning lane. The Waymo Driver system classified the bot as an inanimate object and applied hard braking, but made contact at 4 mph. Neither vehicle was damaged, and both companies stated they are working to avoid similar incidents in the future.

Company involved
Waymo and Serve Robotics
AI system involved
Waymo Driver and Serve delivery robot

1 source article · read the reporting →

WF-EDM4F821 May 2024

Waymo recalls robotaxi software after crash into telephone pole

On May 21, 2024, a Waymo autonomous vehicle crashed into a telephone pole in Phoenix, Arizona, while driving to a passenger pickup location. The vehicle was damaged but no one was injured. Waymo issued a voluntary recall and updated the software and mapping for its entire fleet of 672 vehicles to correct an error that assigned a low damage score to the pole and to improve the map.

Company involved
Waymo
AI system involved
Waymo autonomous vehicle

6 source articles · read the reporting →

WF-HW23LM1 Dec 2023

Alibaba among firms fooled by AI-hallucinated software package

Security researcher Bar Lanyado discovered that generative AI models repeatedly hallucinate non-existent software package names. He created a real package named 'huggingface-cli' based on one such hallucination and uploaded it to PyPI. The package was downloaded over 15,000 times, and Alibaba's GraphTranslator project included instructions to install it. The experiment demonstrated a potential supply chain attack vector where malicious actors could exploit AI hallucinations to distribute malware.

Company involved
Alibaba
AI system involved
GraphTranslator

4 source articles · read the reporting →

WF-J8EHEE23 Sep 2021

Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured

On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.

Company involved
Xpeng Motors
AI system involved
NGP automatic navigation assisted driving system

1 source article · read the reporting →

WF-P25C8Q16 Feb 2023

Tesla Recalls 360,000 Vehicles with Full Self-Driving Beta Over Crash Risk

Tesla is recalling more than 360,000 vehicles equipped with its Full Self-Driving Beta software after a government regulator found that the cars could proceed through intersections without stopping, posing a crash risk. The company said it would issue a remote software update to remedy the problem. The recall is a significant setback for Tesla's autonomous driving ambitions.

Company involved
Tesla
AI system involved
Full Self-Driving Beta

10 source articles · read the reporting →

WF-JX049M10 Oct 2024

Alcon Entertainment sues Tesla and Elon Musk over AI-generated Blade Runner 2049 imagery

Alcon Entertainment, the producer of Blade Runner 2049, has sued Tesla, Elon Musk, and Warner Bros Discovery, alleging they used AI to create promotional imagery based on the film for Tesla's robotaxi launch event on 10 October 2024. Alcon claims it had specifically denied a request from Warner Bros to use material from the film. The lawsuit alleges misappropriation and false endorsement, and describes the financial magnitude of the misappropriation as substantial.

Company involved
Tesla

6 source articles · read the reporting →

Google Antigravity AI Deletes User's Entire Drive Partition

A user of Google's Antigravity AI coding platform lost all data on their D: drive after the AI agent executed a command with a path parsing error. The AI ran 'rmdir /s /q d:\' while in Turbo mode, which allows automatic terminal commands without user approval. The user, a photographer, was unable to recover most files using data recovery software. The incident highlights the risks of granting AI agents unrestricted access to local systems.

Company involved
Google
AI system involved
Antigravity

2 source articles · read the reporting →

page 1 of 2Older →