ACLU test finds Rekognition falsely matches 27 New England athletes to mugshots
The ACLU of Massachusetts conducted a test using Amazon's Rekognition facial recognition technology, comparing headshots of 188 New England professional athletes to a database of 20,000 arrest photos. The software falsely matched 27 athletes, including Patriots safety Duron Harmon. The ACLU is calling for a moratorium on government use of face surveillance technology.
- Company involved
- ACLU of Massachusetts
- AI system involved
- Rekognition
8 source articles · read the reporting →
Suspended ACSO investigator arraigned for alleged Flock camera misuse - NEWS10 ABC
Unauthorized access to license plate data of ex-girlfriend and four other individuals
- Company involved
- Flock
- AI system involved
- Flock
1 source article · read the reporting →
Apple iPhone crash detection triggers false 911 calls from skiers in Colorado
Apple's crash detection feature on iPhone 14 and Apple Watch automatically calls 911 when it detects a sudden stop, but on ski slopes it misinterprets falls as car crashes. Dispatch centers in Colorado ski towns received dozens of false calls daily, diverting resources from real emergencies. Apple acknowledged the issue and said it is working on a fix, but the problem persists.
- Company involved
- Apple Inc.
- AI system involved
- Crash detection and fall detection on iPhone 14 and Apple Watch
10 source articles · read the reporting →
Cense exposed 2.5 million records of auto accident victims online
On July 7, 2020, a security researcher discovered 2.5 million records containing personal and medical data of auto accident victims exposed online. The records, belonging to New York-based AI company Cense, included names, insurance policy numbers, claim numbers, and medical diagnosis notes. The data was labeled as staging data, possibly intended for temporary storage before being loaded into an AI system. After the researcher sent a responsible disclosure notice, Cense restricted public access to the database.
- Company involved
- Cense
- AI system involved
- Cense
5 source articles · read the reporting →
Titus Henderson files civil rights lawsuit against COMPAS
Titus Henderson, a prisoner, filed a civil rights lawsuit against COMPAS and other defendants in the U.S. District Court for the Western District of Wisconsin on July 16, 2018. The lawsuit alleges discrimination related to the use of the COMPAS risk assessment tool. The case is ongoing.
- AI system involved
- COMPAS
6 source articles · read the reporting →
CanLII sues Caseway AI for scraping legal database
The Canadian Legal Information Institute (CanLII) has filed a lawsuit in British Columbia Supreme Court against Caseway AI, alleging that the company's AI chatbot scraped approximately 3.5 million records from CanLII's database in bulk, violating its terms of service and copyright. CanLII claims it adds value to public court records through hyperlinks and corrections, which it says constitute protected copyrighted work. Caseway AI argues the information is public and accessible elsewhere, and that it did not use CanLII's enhancements. The lawsuit was settled in March 2026, with terms undisclosed.
- Company involved
- Canadian Legal Information Institute (CanLII)
- AI system involved
- Caseway
5 source articles · read the reporting →
NHTSA investigates Detroit Tesla crash that critically injured passenger
The National Highway Traffic Safety Administration is investigating a violent crash on March 11 in Detroit involving a Tesla sedan and a semi-truck. The car became wedged under the trailer, leaving a passenger in critical condition. Investigators have not yet determined whether Tesla's Autopilot, Full Self-Driving or FSD beta systems were engaged. The NHTSA has launched a Special Crash Investigation team to probe the incident.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles
The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.
- Company involved
- Tesla Inc.
- AI system involved
- Autopilot
10 source articles · read the reporting →
Cruise robotaxi hits San Francisco fire truck, one injured
A Cruise self-driving car collided with a San Francisco Fire Department truck that was responding to an emergency. The incident occurred on August 17, 2023, in the Tenderloin district. One passenger sustained non-severe injuries and was taken to hospital. Cruise acknowledged the crash and offered support to the rider.
- Company involved
- Cruise
- AI system involved
- Cruise self-driving car
10 source articles · read the reporting →
Motorcyclist sues General Motors after self-driving Chevrolet Bolt crash in San Francisco
On 7 December 2017, a self-driving Chevrolet Bolt operated by GM's Cruise subsidiary aborted a lane change and re-entered its lane on Oak Street in San Francisco, striking motorcyclist Oscar Nilsson and knocking him to the ground. Nilsson sued General Motors, claiming neck and shoulder injuries requiring lengthy treatment and resulting in disability leave. The San Francisco Police Department's report blamed Nilsson for passing on the right, but his lawyer disputed this, and GM denied responsibility while emphasising safety.
- Company involved
- General Motors
- AI system involved
- Chevrolet Bolt autonomous vehicle
10 source articles · read the reporting →
Tesla Model X on Autopilot crashes into police car, injuring five officers
On February 27, 2021, a Tesla Model X operating on Autopilot crashed into a stationary police vehicle on a highway near Montgomery County, Texas, injuring five officers and hospitalizing the subject of a traffic stop. The driver was intoxicated and the system had alerted him 150 times to apply force to the steering wheel. The National Highway Traffic Safety Administration (NHTSA) is investigating the incident, along with 15 other similar crashes involving Teslas and emergency vehicles.
- Company involved
- Tesla
- AI system involved
- Autopilot
10 source articles · read the reporting →
EvenUp AI errors in personal injury demand letters lead to scrutiny
EvenUp, a legal tech startup valued at $1 billion, uses AI to draft personal injury demand letters. Former employees revealed that the AI system frequently makes errors, including missing injuries and fabricating medical conditions. The company defends its hybrid approach with human oversight, but critics allege overpromised AI capabilities.
- Company involved
- EvenUp
6 source articles · read the reporting →
Driver relying on "smart driving" on highway crashes after system suddenly disengages near truck
司机依赖“智驾 ”跑高速，逼近大货车时“智驾”突然退出引发车祸 - 手机新浪网
A driver was using a smart driving system on an expressway. As the vehicle approached a large truck, the system unexpectedly disengaged, leading to a crash.
1 source article · read the reporting →
Audit of RisCanvi finds biases and reliability issues in criminal justice system
Eticas conducted an adversarial audit of RisCanvi, an AI risk assessment tool used in Catalonia's criminal justice system. The audit uncovered biases in risk classifications against specific demographics and significant reliability issues. The findings call for fairer practices in criminal justice AI.
- Company involved
- Catalonia's criminal justice system
- AI system involved
- RisCanvi
4 source articles · read the reporting →
Thomson Reuters wins copyright lawsuit against AI startup Ross Intelligence
In 2020, Thomson Reuters filed a copyright lawsuit against legal AI startup Ross Intelligence, alleging that Ross reproduced materials from its Westlaw legal research service. In February 2025, a US District Court judge ruled in Thomson Reuters' favor, finding that Ross infringed copyright and that fair use did not apply. Ross Intelligence had shut down in 2021 due to litigation costs.
- Company involved
- Ross Intelligence
- AI system involved
- Ross Intelligence
4 source articles · read the reporting →
Hello robotaxi crash injures pedestrians in Zhuzhou, China
A Hello Inc. robotaxi struck and injured two pedestrians in Zhuzhou, China, on or around December 5, 2025. Footage showed bystanders and police lifting the vehicle to free a person trapped underneath. Hello has suspended autonomous-driving operations in Zhuzhou. Local police have not yet determined fault, and Hello has not commented. The crash follows a prior incident where a Hello robotaxi allegedly failed to stop after a collision.
- Company involved
- Hello Inc.
- AI system involved
- Hello Autonomous Driving
3 source articles · read the reporting →
Dutch probation service's OXREC algorithm flawed, leading to incorrect recidivism risk assessments
The Dutch Inspectorate of Justice and Security (Inspectie JenV) published a report finding that the probation service's (Reclassering) OXREC algorithm contains serious flaws, including swapped formulas and incorrect numbers, causing about a quarter of risk assessments to be wrong. The algorithm, used since 2018 for about 44,000 cases per year, also uses variables that can lead to discrimination, such as neighborhood score and income. The Inspectorate recommended immediate correction or temporary suspension. The probation service announced it would temporarily stop using OXREC.
- Company involved
- Reclassering Nederland
- AI system involved
- OXREC
4 source articles · read the reporting →
NHTSA investigation PE24016: Unexpected ADS behavior
Waymo's automated driving system exhibited unexpected behavior during driving.
- Company involved
- Waymo
1 source article · read the reporting →
Tesla Cybertruck owner sues over FSD crash in Houston overpass
Justine Saint Amour is suing Tesla after her Cybertruck, with Full Self-Driving engaged, crashed into a concrete barrier on a Houston overpass on August 18, 2025. The lawsuit alleges that Tesla was negligent in hiring and retaining Elon Musk as CEO, and that the FSD system was defective due to lack of LiDAR and ineffective automatic emergency braking. Saint Amour seeks over $1 million in damages.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving (FSD)
3 source articles · read the reporting →
Cruise Self-Driving Car Rear-Ended by Human-Driven Cruise Vehicle in San Francisco
On 11 June 2018, a self-driving Cruise Chevrolet Bolt was rear-ended by another Cruise vehicle driven by a human employee on Bryant Street in San Francisco. The collision caused only minor scuffs and no injuries. Cruise reported the incident to the California DMV as required. The incident highlights the challenges of autonomous vehicles interacting with human drivers.
- Company involved
- Cruise
2 source articles · read the reporting →
California AG declares out-of-state ALPR data sharing unlawful
California Attorney General Rob Bonta issued guidance confirming that sharing automated license plate reader (ALPR) data with out-of-state or federal agencies violates state law SB 34. The decision follows years of advocacy by EFF and the ACLU, who demonstrated through public records that many California law enforcement agencies were sharing data with hundreds of external agencies, including ICE and CBP. The guidance mandates that all California agencies review their data sharing and cut off access to out-of-state and federal entities.
- Company involved
- California law enforcement agencies
- AI system involved
- Automated license plate readers (ALPRs)
1 source article · read the reporting →
Tesla Model X on Autopilot hits crash attenuator in Mountain View, killing driver
On 23 March 2018, a Tesla Model X P100D operating with Autopilot hit a damaged crash attenuator on US Highway 101 in Mountain View, California, killing the driver. The NTSB found that Autopilot steered the vehicle into a highway gore area because of system limitations, and that the driver was distracted and over-reliant on the partial driving automation. Two other vehicles were struck; one driver sustained minor injuries.
- Company involved
- Tesla
- AI system involved
- Autopilot
9 source articles · read the reporting →
Beep automated bus rear-ended by Tesla in Washington D.C.
An automated bus operated by Beep was rear-ended by a Tesla driver making an illegal lane change in Washington D.C. on 18 January 2026. The bus, part of a pilot programme with the U.S. Department of Transportation, had a human backup driver and sustained minor cosmetic damage. Service was temporarily paused but resumed after a review found the bus operated appropriately. No police were called and the incident was not reported to NHTSA as the damage was under $1,000 and the other driver was at fault.
- Company involved
- Beep
- AI system involved
- Beep automated bus
2 source articles · read the reporting →
Tesla in self-drive mode crashes into Fullerton police car
A Tesla operating in self-drive mode crashed into a parked Fullerton police car while the officer was outside directing traffic at a fatal crash scene. The officer jumped out of the way and was not injured, but the patrol vehicle sustained major damage. The driver admitted to using a cellphone at the time. It is unclear if the driver will be cited.
- AI system involved
- Tesla Full Self-Driving (Supervised)
1 source article · read the reporting →
