Tesla Staged 2016 Self-Driving Video, Deposition Reveals
In October 2016, Tesla published a video titled 'Full Self-Driving Hardware on all Teslas' showing a car driving itself without human input. A deposition by Tesla's director of Autopilot software, Ashok Elluswamy, revealed that the video was staged on a predetermined route and that the car crashed into a fence during filming. The production version of Autopilot at the time did not have the capability to respond to traffic lights as shown. Tesla and Elon Musk did not disclose that the video was edited to portray the system more favourably.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving Hardware
6 source articles · read the reporting →
TuSimple self-driving truck crashes in Arizona after system executes old command
In April 2022, a TuSimple autonomous semi-trailer truck travelling on I-10 in Tucson, Arizona, suddenly veered left and struck a concrete divider. The company initially blamed human error, but an internal report revealed that the crash occurred because an operator failed to properly reboot the system, causing it to execute a 2.5-minute-old left-turn command. No injuries or property damage were reported. Federal regulators, including the FMCSA and NHTSA, have launched investigations into the incident.
- Company involved
- TuSimple
2 source articles · read the reporting →
Zoox Recalls Software After Autonomous Vehicles Cross Lane Lines
Zoox issued a voluntary software recall for 332 autonomous vehicles after identifying instances where the vehicles crossed center lane lines or blocked crosswalks. The issue, first observed on August 26, 2025, involved a robotaxi making a wide turn into an opposing lane. No collisions occurred, but the company acknowledged the risk and deployed software updates in November and December to correct the behavior. Zoox is in ongoing discussions with NHTSA about the incidents.
- Company involved
- Zoox
- AI system involved
- Zoox autonomous driving system
2 source articles · read the reporting →
X's Grok AI Image Generator Lacks Guardrails, Users Create Offensive Images of Trademarked Characters
On August 14, 2024, X rolled out image generation capabilities for its Grok AI chatbot to Premium users. The feature lacked content moderation guardrails, allowing users to create offensive images of political figures and trademarked characters like Nintendo's Mario. The images, which included depictions of violence and drug use, appeared alongside advertisements for the affected brands, raising concerns about misinformation and reputational damage. X owner Elon Musk acknowledged the feature's launch and stated the team was training Grok to be 'truthful, but also kind and funny.'
- Company involved
- X
- AI system involved
- Grok-2
3 source articles · read the reporting →
Waymo robotaxi and Serve delivery robot collide in Los Angeles
On December 27, 2024, a Waymo robotaxi and a Serve Robotics sidewalk delivery robot collided at an intersection in West Hollywood, Los Angeles. The Waymo vehicle was making a right turn when the Serve bot, under remote supervision, moved into the turning lane. The Waymo Driver system classified the bot as an inanimate object and applied hard braking, but made contact at 4 mph. Neither vehicle was damaged, and both companies stated they are working to avoid similar incidents in the future.
- Company involved
- Waymo and Serve Robotics
- AI system involved
- Waymo Driver and Serve delivery robot
1 source article · read the reporting →
Volvo self-driving car blinded by snow in Sweden test
During testing in Jokkmokk, Sweden, a Volvo self-driving XC90 SUV's radar sensors became caked with frozen flakes, rendering the vehicle unable to read the road. The incident highlighted the challenge of snow blindness for autonomous vehicles. Ford engineers later proposed a solution using lidar to create high-definition 3-D maps.
- Company involved
- Volvo Cars
- AI system involved
- self-driving XC90 SUV
4 source articles · read the reporting →
Waymo recalls robotaxi software after crash into telephone pole
On May 21, 2024, a Waymo autonomous vehicle crashed into a telephone pole in Phoenix, Arizona, while driving to a passenger pickup location. The vehicle was damaged but no one was injured. Waymo issued a voluntary recall and updated the software and mapping for its entire fleet of 672 vehicles to correct an error that assigned a low damage score to the pole and to improve the map.
- Company involved
- Waymo
- AI system involved
- Waymo autonomous vehicle
6 source articles · read the reporting →
Alibaba among firms fooled by AI-hallucinated software package
Security researcher Bar Lanyado discovered that generative AI models repeatedly hallucinate non-existent software package names. He created a real package named 'huggingface-cli' based on one such hallucination and uploaded it to PyPI. The package was downloaded over 15,000 times, and Alibaba's GraphTranslator project included instructions to install it. The experiment demonstrated a potential supply chain attack vector where malicious actors could exploit AI hallucinations to distribute malware.
- Company involved
- Alibaba
- AI system involved
- GraphTranslator
4 source articles · read the reporting →
Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured
On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.
- Company involved
- Xpeng Motors
- AI system involved
- NGP automatic navigation assisted driving system
1 source article · read the reporting →
Tesla Recalls 360,000 Vehicles with Full Self-Driving Beta Over Crash Risk
Tesla is recalling more than 360,000 vehicles equipped with its Full Self-Driving Beta software after a government regulator found that the cars could proceed through intersections without stopping, posing a crash risk. The company said it would issue a remote software update to remedy the problem. The recall is a significant setback for Tesla's autonomous driving ambitions.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving Beta
10 source articles · read the reporting →
Alcon Entertainment sues Tesla and Elon Musk over AI-generated Blade Runner 2049 imagery
Alcon Entertainment, the producer of Blade Runner 2049, has sued Tesla, Elon Musk, and Warner Bros Discovery, alleging they used AI to create promotional imagery based on the film for Tesla's robotaxi launch event on 10 October 2024. Alcon claims it had specifically denied a request from Warner Bros to use material from the film. The lawsuit alleges misappropriation and false endorsement, and describes the financial magnitude of the misappropriation as substantial.
- Company involved
- Tesla
6 source articles · read the reporting →
Google Antigravity AI Deletes User's Entire Drive Partition
A user of Google's Antigravity AI coding platform lost all data on their D: drive after the AI agent executed a command with a path parsing error. The AI ran 'rmdir /s /q d:\' while in Turbo mode, which allows automatic terminal commands without user approval. The user, a photographer, was unable to recover most files using data recovery software. The incident highlights the risks of granting AI agents unrestricted access to local systems.
- Company involved
- Google
- AI system involved
- Antigravity
2 source articles · read the reporting →
Waymo recalls 3,500 robotaxis after vehicle enters flooded Texas road
On April 20, 2026, an unoccupied Waymo robotaxi entered a flooded road in San Antonio, Texas, during severe weather. No injuries occurred, but the incident prompted Waymo to issue a voluntary recall of up to 3,791 vehicles due to software that could allow the cars to drive onto flooded roads. The National Highway Traffic Safety Administration published recall documents, and Waymo stated it is implementing additional software safeguards and has restricted operations in extreme weather. The fix is still under development.
- Company involved
- Waymo
- AI system involved
- Waymo autonomous driving system
4 source articles · read the reporting →
Tesla Cybertruck on Full Self-Driving Crashes into Pole in Reno
A Tesla Cybertruck owner in Reno, Nevada, reported that his vehicle, operating on Full Self-Driving version 13.2.4, failed to merge from a lane that was ending and drove onto a curb, striking a light pole. The driver, Jonathan Challinger, was uninjured and praised Tesla's safety, while acknowledging he should have been paying attention. The incident occurred on Stead Boulevard with no other traffic present, and the owner attempted to contact Tesla's service centre, which was reportedly unresponsive.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving v13.2.4
8 source articles · read the reporting →
Google's Gemini AI Allegedly Scans Private Drive PDFs Without Permission
Kevin Bankston, a privacy activist, alleges that Google's Gemini AI automatically summarised his private tax return PDF in Google Drive without his explicit consent. Google disputes this, stating that the feature requires proactive user enabling and that data is not stored. Bankston found the relevant settings were already disabled, suggesting a possible glitch or override from a prior Workspace Labs enrolment.
- Company involved
- Google
- AI system involved
- Gemini AI
1 source article · read the reporting →
Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops
Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving (FSD) beta
5 source articles · read the reporting →
Hikvision sells Uyghur recognition system to Chinese authorities
Hikvision, a Chinese surveillance company, sold a facial recognition system powered by NVIDIA to authorities in the People's Republic of China. The system is designed to identify Uyghur individuals, enabling ethnic profiling and surveillance. The article reports that the system was marketed as a tool for public security and was deployed without transparency or accountability. No specific incident of harm is described, but the potential for widespread discrimination and human rights abuses is highlighted.
- Company involved
- Hikvision
- AI system involved
- Uyghur recognition system
10 source articles · read the reporting →
Tesla Full Self-Driving confused by truck carrying traffic lights
A Tesla vehicle using Full Self-Driving mode encountered a truck loaded with traffic lights. The system identified the traffic lights on the truck but was unable to determine the correct action, creating a confusing edge case. The incident was shared on social media, highlighting a limitation of the autonomous driving system.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
2 source articles · read the reporting →
Researchers demonstrate drone attack on Renault Captur ADAS with fake road signs
Security researchers from Ben Gurion University demonstrated a vulnerability in the Mobileye ADAS system used in a Renault Captur. They used drones to project fake road signs for 100 milliseconds, too quick for human perception but detectable by the system. The attack could trick the car into making unsafe maneuvers, though the system is only Level 0 (advisory). The researchers published their findings in a paper titled 'MobilBye: Attacking ADAS with Camera Spoofing'.
- AI system involved
- Mobileye ADAS
7 source articles · read the reporting →
Nvidia releases AI-powered Eye Contact feature for Broadcast app
Nvidia has released a beta version of Eye Contact, an AI-powered feature for its Broadcast app that replaces a user's eyes in video streams with simulated eyeballs that always face the camera. The feature is intended to maintain eye contact even when the user looks away, but social media response has been largely negative. A former TV news anchor said that unbroken eye contact can be regarded as creepy or uncomfortable.
- Company involved
- Nvidia
- AI system involved
- Eye Contact
8 source articles · read the reporting →
Delphi denies near-miss between its self-driving car and Google's autonomous vehicle
Delphi Automotive initially reported a near-miss between its self-driving Audi Q5 SUV and a Google Lexus RX400h in Palo Alto, California. A Delphi executive claimed Google's car cut off the Delphi vehicle, which took evasive action. However, Delphi later denied the incident, stating the vehicles were a lane width apart and that both cars performed correctly. Google also confirmed the cars behaved appropriately in an ordinary driving scenario.
- Company involved
- Delphi Automotive
- AI system involved
- Delphi self-driving car (Audi Q5 SUV)
7 source articles · read the reporting →
Serbia's Ministry of Interior deploys thousands of Huawei facial recognition cameras in Belgrade
In early 2019, Serbia's Ministry of Interior announced the deployment of a thousand smart surveillance cameras with facial and license plate recognition capabilities, supplied by Huawei, across Belgrade. The Ministry refused to release information about the project, citing confidentiality, and failed to conduct a legally required Data Protection Impact Assessment. Citizens responded by crowdsourcing camera locations via the hashtag #hiljadekamera and a website. The system remains in operation with no public debate or transparency.
- Company involved
- Ministry of Interior
- AI system involved
- Huawei smart surveillance cameras
10 source articles · read the reporting →
Google Health's diabetic retinopathy AI faced real-world issues in Thailand clinics
Google Health deployed a deep-learning system to screen for diabetic retinopathy in 11 clinics across Thailand. The AI was highly accurate in lab tests but rejected over a fifth of eye scans in real-world conditions due to poor lighting and slow internet. Patients whose scans were rejected had to visit specialists at other clinics, causing inconvenience and frustration for nurses. Google Health is now working with local staff to improve the system's workflow.
- Company involved
- Google Health
10 source articles · read the reporting →
Cruise alleged to rely on human operators for autonomous driving
A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.
- Company involved
- Cruise
- AI system involved
- Cruise AV
9 source articles · read the reporting →
