IDF Used AI System Lavender to Target Tens of Thousands in Gaza
The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.
- Company involved
- Israel Defense Forces
- AI system involved
- Lavender
9 source articles · read the reporting →
Amazon Alexa gives shocking challenge to 10-year-old
A parent reported that their 10-year-old child asked an Amazon Echo device with Alexa for a challenge, and Alexa responded with something the parent found shocking. The incident was shared on Twitter on 26 December 2021. No further details about the response or any harm were provided.
- Company involved
- Amazon
- AI system involved
- Alexa
3 source articles · read the reporting →
NYPD Facial Recognition Leads to Wrongful Arrest of Trevis Williams
In April 2025, Trevis Williams was arrested by the NYPD after a facial recognition program matched his mug shot to a suspect in a February flashing incident, despite an eight-inch height difference and alibi evidence. The victim identified him from the AI-suggested photo array. Mr. Williams spent over two days in jail before the case was dismissed in July. The incident highlights the risks of using facial recognition on low-quality surveillance images.
- Company involved
- New York Police Department
2 source articles · read the reporting →
San Francisco Police Wrongfully Stop Woman at Gunpoint After License Plate Reader Error
On March 30, 2009, Denise Green, a 47-year-old African-American woman, was driving in San Francisco when an automatic license plate reader misread her plate as stolen. Despite discrepancies between the vehicle description and the stolen plate, officers conducted a felony stop, ordering her out at gunpoint and handcuffing her for nearly 20 minutes. Green filed a civil rights lawsuit alleging Fourth Amendment violations. The Ninth Circuit Court of Appeals reinstated her case, finding that the officers lacked reasonable suspicion for the stop.
- Company involved
- San Francisco Police Department
1 source article · read the reporting →
Las Vegas police used unsuitable facial recognition images in nearly half of searches
The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.
- Company involved
- Las Vegas Metropolitan Police Department
- AI system involved
- Vigilant Solutions facial recognition system
1 source article · read the reporting →
Tesla Model X crash in Seoul kills owner; police investigate defect
Police are investigating a Tesla Model X crash in Yongsan, Seoul, that killed the car owner and injured the driver and an apartment employee. The driver testified that he suddenly lost control as the car drove into a wall and caught fire. A court warrant has allowed forensic examination of the vehicle. Tesla has denied that its vehicles have acceleration malfunctions.
- Company involved
- Tesla
- AI system involved
- Tesla Model X
6 source articles · read the reporting →
NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram
The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.
- Company involved
- NYPD
- AI system involved
- Facial Identification Section
3 source articles · read the reporting →
Beep automated bus rear-ended by Tesla in Washington D.C.
An automated bus operated by Beep was rear-ended by a Tesla driver making an illegal lane change in Washington D.C. on 18 January 2026. The bus, part of a pilot programme with the U.S. Department of Transportation, had a human backup driver and sustained minor cosmetic damage. Service was temporarily paused but resumed after a review found the bus operated appropriately. No police were called and the incident was not reported to NHTSA as the damage was under $1,000 and the other driver was at fault.
- Company involved
- Beep
- AI system involved
- Beep automated bus
2 source articles · read the reporting →
Tesla in self-drive mode crashes into Fullerton police car
A Tesla operating in self-drive mode crashed into a parked Fullerton police car while the officer was outside directing traffic at a fatal crash scene. The officer jumped out of the way and was not injured, but the patrol vehicle sustained major damage. The driver admitted to using a cellphone at the time. It is unclear if the driver will be cited.
- AI system involved
- Tesla Full Self-Driving (Supervised)
1 source article · read the reporting →
Xiaomi SU7 fatal crash in Chengdu raises EV safety concerns
A Xiaomi SU7 electric vehicle crashed in Chengdu, China, and caught fire. Bystanders were unable to open the electronic door handles to rescue an occupant, and a 31-year-old male driver died. The incident follows an earlier fatal SU7 crash that raised questions about the vehicle's smart driving features, and has intensified scrutiny on electronic door handle safety.
- Company involved
- Xiaomi
- AI system involved
- SU7
3 source articles · read the reporting →
Minor from Tira indicted for attempted terror attack after consulting ChatGPT
A 16-year-old from Tira allegedly consulted ChatGPT about methods to carry out a terror attack before attempting to stab a border police officer at a police station. The minor, motivated by nationalist ideology, brandished a knife and shouted 'Allahu Akbar' but was stopped before causing injury. He has been indicted for attempted aggravated assault as a terror act, and the prosecution seeks detention until the end of proceedings.
- AI system involved
- ChatGPT
2 source articles · read the reporting →
NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged
The system made driving decisions that violated traffic safety laws, affecting other road users.
- Company involved
- Tesla, Inc.
- AI system involved
- Full Self Driving (FSD)
1 source article · read the reporting →
Volusia County Schools' Gaggle AI flags threat, leading to student's arrest
A 15-year-old student at Deltona High School wrote a threat on his school laptop, which was flagged by the Gaggle monitoring system. The alert notified a school resource deputy, who detained the student before he could leave. The teen admitted to the threat, saying he was angry about being bullied, and was arrested on a second-degree felony charge.
- Company involved
- Volusia County Schools
- AI system involved
- Gaggle
1 source article · read the reporting →
Tesla Full Self-Driving involved in fatal pedestrian crash in Arizona
In November 2023, a Tesla Model Y with Full Self-Driving engaged struck and killed 71-year-old Johna Story on Interstate 17 in Arizona. The system failed to brake due to sun glare, according to footage obtained by Bloomberg. The victim's family has sued Tesla and the driver. NHTSA is investigating whether the system poses an unacceptable safety risk.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Waymo Self-Driving Taxis Proactively Report to Police After Discovering Passenger Hiding a Gun
قامت سيارات الأجرة ذاتية القيادة من شركة Waymo بإبلاغ الشرطة بشكل استباقي بعد اكتشافها أن أحد الركاب كان يخفي مسدساً.…
A Waymo self-driving taxi in San Francisco detected two teenage passengers carrying an unidentified AR-15 rifle loaded with ammunition. The vehicle automatically stopped and alerted police, leading to the arrest of the two teenagers. Waymo stated that its system can identify violations of its terms of service, including carrying weapons, and will proactively notify police.
- Company involved
- Waymo
1 source article · read the reporting →
Police Investigator Accused of Making Over 4,000 Illegal Flock Camera Searches - Futurism
The system allowed unauthorized tracking of individuals' vehicles through license plate recognition, affecting five subjects including an ex-girlfriend who was searched 3,000 times.
- Company involved
- Albany County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Former Police Officer Sentenced to 5 Years After Misusing Flock Cameras To Stalk Ex-Girlfriend - Texas Scorecard
Former officer used Flock cameras to surveil and stalk his ex-girlfriend, her family members, and other romantic interests.
- Company involved
- Flock Safety
1 source article · read the reporting →
Two Florida deputies arrested for Flock, ALPR abuse after TCPalm query - Yahoo
The Flock ALPR system was used by deputies to track the locations of a woman and a teenage girl for personal, non-law-enforcement purposes.
- Company involved
- Pinellas County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Sibuxiang Genuine + Genuine Sibuxiang: Tesla Autopilot in Another Accident, Owner Says System Failed to Recognize Construction Barriers, Causing Rear-End…
四不像正版+正版四不像特斯拉自动驾驶再出事故，车主称系统未识别施工路障致追尾 - Pchome电脑之家
A Tesla owner reported that the vehicle's Autopilot system did not detect construction barriers, leading to a rear-end collision. The incident was reported by Pchome.
- Company involved
- Tesla
- AI system involved
- Autopilot
1 source article · read the reporting →
Senate hearing targets Flock Safety as officers face misuse charges - FOX 5 Atlanta
The system incorrectly linked Lindsey Isaacs's vehicle to a fatal crash scene, leading to her wrongful arrest and 13-day detention.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety automated license plate reader
1 source article · read the reporting →
Evolv backtracks on claimed UK government testing of AI weapons scanner
Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.
- Company involved
- Evolv Technology
- AI system involved
- Evolv Express
3 source articles · read the reporting →
Sue Neill-Fraser: AI hallucinations in a parole decision (Tasmania)
The Parole Board imposed a condition preventing Susan Neill-Fraser from communicating with the media to claim innocence.
- Company involved
- Tasmania Parole Board
1 source article · read the reporting →
Kingsville police officer resigns after investigation into alleged Flock camera misuse - Yahoo
Kingsville police officer resigns after investigation into alleged Flock camera misuse Yahoo
- Company involved
- Kingsville Police Department
- AI system involved
- Flock camera system
1 source article · read the reporting →
Whiteside County sergeant misused license plate reader data, resigned; state police reviewing case: Sheriff - Shaw Local
The system collected license plate data on vehicles, and the sergeant accessed it without a legitimate law enforcement purpose.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
