Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal
Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.
- Company involved
- Secretaria de Segurança Pública da Bahia
2 source articles · read the reporting →
San Jose is training AI to spot homeless encampments in first US pilot
San Jose has been running a pilot in which cameras on a municipal vehicle feed computer vision software being trained to detect lived-in vehicles and homeless encampments in District 10. The scheme, believed to be the first of its kind in the US, has prompted concern among housing advocates that it could be used to punish and displace unhoused residents. The city says the aim is to respond more efficiently to complaints about encampments and that the footage is not being actively monitored for law enforcement.
- Company involved
- City of San Jose
10 source articles · read the reporting →
Tesla Full Self-Driving system fails to recognise train, driver intervenes
A Tesla owner in Ohio reported that his car in Full Self-Driving mode attempted to drive into a crossing train on May 8, 2024. The driver took control and avoided a collision, but the car hit the crossing arm causing damage. The driver said it was the second such incident in six months. Tesla did not respond to requests for comment.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving (FSD)
8 source articles · read the reporting →
Cruise Self-Driving Car Rear-Ended by Human-Driven Cruise Vehicle in San Francisco
On 11 June 2018, a self-driving Cruise Chevrolet Bolt was rear-ended by another Cruise vehicle driven by a human employee on Bryant Street in San Francisco. The collision caused only minor scuffs and no injuries. Cruise reported the incident to the California DMV as required. The incident highlights the challenges of autonomous vehicles interacting with human drivers.
- Company involved
- Cruise
2 source articles · read the reporting →
Xuhui police expand facial recognition surveillance to profile 1.1 million residents
The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.
- Company involved
- Shanghai Municipal Bureau of Public Security, Xuhui District Branch
- AI system involved
- Intelligent Image Recognition System
3 source articles · read the reporting →
AI-powered tram crashes into pedestrians in St Petersburg test run
An AI-powered 'Smart Tram' on a test run in St Petersburg, Russia, crashed into pedestrians after its AI system turned off and brakes failed. The driver, who was present, attempted to use emergency brakes but they did not fully work. Several people were injured, including a 45-year-old woman trapped under the tram. The city authorities have launched an investigation and a criminal case has been opened.
- Company involved
- St Petersburg city authorities
- AI system involved
- Smart Tram
1 source article · read the reporting →
Facebook's automated ad system rejects adaptive fashion ads
Small adaptive fashion companies have had their advertisements repeatedly rejected by Facebook's automated advertising system, which misidentifies their products as medical devices. The system's inability to understand context leads to discrimination against people with disabilities. Facebook has acknowledged the issue and restored some ads, but the problem persists, highlighting biases in machine learning.
- Company involved
- Facebook
- AI system involved
- Facebook automated advertising review system
2 source articles · read the reporting →
Father Sues Tesla After Son's Fatal Autopilot Crash in China
In January 2016, Gao Yaning died when his Tesla Model S crashed into a road sweeper on a highway in Hebei, China. His father, Gao Jubin, alleges the car was using Autopilot, which failed to detect the stationary truck and did not brake. Jubin filed a lawsuit against Tesla, accusing the company of exaggerating Autopilot's capabilities, and the case remains ongoing. Tesla has stated that it is cooperating with the investigation and that the system functioned as designed.
- Company involved
- Tesla
- AI system involved
- Autopilot
4 source articles · read the reporting →
West Midlands Police test NDAS system to assess crime risk
West Midlands Police are testing a system called the National Data Analytics Solution (NDAS) that analyses police data to assess the risk of individuals committing a crime or becoming a victim. The Home Office has funded the project with millions of pounds, intending to roll it out across England and Wales. Critics warn that the system could reinforce bias against minorities and undermine the presumption of innocence. The police say the technology is designed to support, not replace, officer decision-making and that it is still in early testing.
- Company involved
- West Midlands Police
- AI system involved
- National Data Analytics Solution
1 source article · read the reporting →
Ola drivers file GDPR lawsuit over algorithmic management and data access
Two ride-hailing drivers are taking Ola to court in Amsterdam, alleging the company violated GDPR data access rights by not providing full personal data, including GPS and ratings information. They argue this hinders their ability to challenge algorithmic decisions, such as a driver who had pay docked after Ola's system incorrectly flagged trips as invalid. The case, supported by the App Drivers & Couriers Union, seeks to compel Ola to comply with data protection law and faces fines for non-compliance. Ola says it has not received notification and complies with all applicable laws.
- Company involved
- Ola
- AI system involved
- Guardian
1 source article · read the reporting →
Google and Delphi Self-Driving Cars Involved in Minor Accidents in California
Four self-driving cars in California have been involved in accidents since September 2014, when the state began issuing testing permits. Two occurred while the cars were in autonomous mode, and two while a human was driving. Google and Delphi, the companies operating the vehicles, stated that their cars were not at fault and that the collisions were minor, with no injuries. The accidents have raised concerns about transparency, as details are kept confidential under state law.
- Company involved
- Google Inc. and Delphi Automotive
10 source articles · read the reporting →
Dahua Exposed for Uyghur Tracking Software in Surveillance Systems
Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.
- Company involved
- Dahua Technology
- AI system involved
- Dahua SDK
1 source article · read the reporting →
France uses AI to monitor mask-wearing on public transport
France has deployed AI software from startup DatakaLab in the Paris metro to check if passengers are wearing face masks. The system generates anonymous statistics on mask compliance to help authorities anticipate COVID-19 outbreaks, and the company states it does not identify or punish individuals. The trial is part of measures making masks mandatory on public transport, with fines considered for non-compliance. Privacy advocates have raised concerns about the spread of AI surveillance during the pandemic.
1 source article · read the reporting →
Tesla Model X on Autopilot hits crash attenuator in Mountain View, killing driver
On 23 March 2018, a Tesla Model X P100D operating with Autopilot hit a damaged crash attenuator on US Highway 101 in Mountain View, California, killing the driver. The NTSB found that Autopilot steered the vehicle into a highway gore area because of system limitations, and that the driver was distracted and over-reliant on the partial driving automation. Two other vehicles were struck; one driver sustained minor injuries.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Beep automated bus rear-ended by Tesla in Washington D.C.
An automated bus operated by Beep was rear-ended by a Tesla driver making an illegal lane change in Washington D.C. on 18 January 2026. The bus, part of a pilot programme with the U.S. Department of Transportation, had a human backup driver and sustained minor cosmetic damage. Service was temporarily paused but resumed after a review found the bus operated appropriately. No police were called and the incident was not reported to NHTSA as the damage was under $1,000 and the other driver was at fault.
- Company involved
- Beep
- AI system involved
- Beep automated bus
2 source articles · read the reporting →
Waymo Self-Driving Taxis Crash into Backwards-Towed Pickup in Phoenix
On 11 December 2023, two Waymo autonomous vehicles collided with a pickup truck being towed backwards in Phoenix, Arizona. The vehicles were operating without passengers and sustained minor damage, with no injuries reported. Waymo attributed the crashes to a software error that mispredicted the towed vehicle's motion and subsequently deployed a fix. The company filed a voluntary recall report with the NHTSA.
- Company involved
- Waymo
- AI system involved
- Waymo Driver
3 source articles · read the reporting →
A Waymo Drove Into a Denver Farmers Market. Colorado Police Had No Mechanism to Ticket It. - Gadget Review
A driverless Waymo entered a Denver farmers market past barricades and a stop sign, disrupting vendors and staff.
- Company involved
- Waymo
- AI system involved
- Waymo
1 source article · read the reporting →
Buena Vista Crash Killed 82-Year-Old — Tesla Records Show Driver-Assist Was On - Hoodline
The Tesla driver-assist system ran a stop sign and struck a Honda Civic, killing its driver, Stephen Field.
- Company involved
- Tesla
1 source article · read the reporting →
NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged
The system made driving decisions that violated traffic safety laws, affecting other road users.
- Company involved
- Tesla, Inc.
- AI system involved
- Full Self Driving (FSD)
1 source article · read the reporting →
Tesla Full Self-Driving involved in fatal pedestrian crash in Arizona
In November 2023, a Tesla Model Y with Full Self-Driving engaged struck and killed 71-year-old Johna Story on Interstate 17 in Arizona. The system failed to brake due to sun glare, according to footage obtained by Bloomberg. The victim's family has sued Tesla and the driver. NHTSA is investigating whether the system poses an unacceptable safety risk.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Woman Blindly Trusts Driver Assistance, Rear-Ends Lane-Changing Bus on Highway
女子轻信辅助驾驶放任不管 高速上直接追尾变道大巴车 - 驱动之家
On August 28, on the Shanghai-Kunming Expressway, a woman driving an SUV with driver assistance engaged rear-ended a bus that suddenly changed lanes. She assumed the system would brake automatically and took no action. The bus driver was found at fault for the lane change, but police warned against over-reliance on driver assistance.
1 source article · read the reporting →
Sibuxiang Genuine + Genuine Sibuxiang: Tesla Autopilot in Another Accident, Owner Says System Failed to Recognize Construction Barriers, Causing Rear-End…
四不像正版+正版四不像特斯拉自动驾驶再出事故，车主称系统未识别施工路障致追尾 - Pchome电脑之家
A Tesla owner reported that the vehicle's Autopilot system did not detect construction barriers, leading to a rear-end collision. The incident was reported by Pchome.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles
Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users
- Company involved
- Zoox
- AI system involved
- Zoox vehicle
1 source article · read the reporting →
Ford BlueCruise crash in Philadelphia kills two, injures one
On March 3, 2024, a Ford Mustang Mach-E operating in hands-free partial automation mode (BlueCruise) collided with stationary vehicles in a work zone on I-95 in Philadelphia. The system recorded a speed of 72.4 mph with no braking or steering before impact. The drivers of the two stationary vehicles died, and the Ford driver was injured. The NTSB determined the probable cause to be driver impairment and distraction due to overreliance on automation, as well as Ford's inadequate integration of speed management with the automation system.
- Company involved
- Ford Motor Company
- AI system involved
- BlueCruise
9 source articles · read the reporting →
