Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments
ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.
- Company involved
- City of Chicago
- AI system involved
- ShotSpotter
7 source articles · read the reporting →
iBorderCtrl lie detector falsely flagged honest reporter as liar
A journalist testing Europe's iBorderCtrl virtual policeman at the Serbian-Hungarian border gave honest answers but was deemed a liar by the system, scoring 48 out of 100 with four false answers flagged. The Hungarian policeman said the result suggested further checks, though none were carried out. The reporter only learned of the result after filing a data access request under European privacy laws. Experts and transparency activists have criticised the technology as pseudoscientific and potentially discriminatory.
- Company involved
- iBorderCtrl consortium
- AI system involved
- Silent Talker / iBorderCtrl virtual policeman
10 source articles · read the reporting →
Evolv weapon detection system falsely flags Chromebooks as weapons
Evolv's AI-based weapon detection system has been reported to falsely identify certain Chromebook laptops as weapons, causing false alarms at security checkpoints. The system is used in venues such as schools. The article discusses the flaw and user experiences. No official response from Evolv has been mentioned.
- Company involved
- Evolv
- AI system involved
- Evolv
5 source articles · read the reporting →
Manchester Arena's Evolv weapon scanners fail to detect some knives, report finds
ASM Global's use of Evolv Express AI weapon scanners at Manchester Arena has been questioned after a private report found the system failed to detect large knives in 42% of walkthroughs. The report, produced by NCS4 and obtained by IPVM, also suggested the scanners may miss some bombs and components. Evolv did not dispute the findings but said it communicates capabilities and limitations to customers. ASM Global declined to comment on security matters.
- Company involved
- ASM Global
- AI system involved
- Evolv Express
5 source articles · read the reporting →
Dallas police used robot to kill gunman after standoff
In July 2016, the Dallas Police Department used a remote-controlled bomb disposal robot to deliver an explosive device to kill Micah Xavier Johnson, a gunman who had killed five police officers and was barricaded in a parking garage. Police Chief David Brown stated that the tactic was used as a last resort to avoid exposing officers to further danger. The incident raised ethical questions about the use of robots for lethal force by law enforcement.
- Company involved
- Dallas Police Department
8 source articles · read the reporting →
Torswats Uses AI-Generated Voice for Nationwide Swatting Campaign
A swatter known as Torswats has been using a computer-generated voice to make bomb and mass shooting threats to police across the United States. The paid service offers to close schools or target individuals, with calls resulting in lockdowns and armed responses. Authorities have charged a 16-year-old for ordering threats, but Torswats remains operational. The FBI is investigating the swatting incidents.
- Company involved
- Torswats
1 source article · read the reporting →
Durham's ShotSpotter fails to detect two deadly shootings
ShotSpotter, a gunshot detection system piloted by the Durham Police Department, failed to detect two fatal shootings in February 2023, as well as a New Year's Day shooting that injured five. The system, which uses sensors and human review to alert police, did not send alerts for these incidents within its three-square-mile coverage area. The company stated it investigated and provided a report to the police, while a city official defended the pilot, noting it is still early in the year-long trial. Community concerns have been raised about increased police presence and potential racial profiling.
- Company involved
- Durham Police Department
- AI system involved
- ShotSpotter
5 source articles · read the reporting →
US Patriot missile downs RAF Tornado, killing two crew
On 22 March 2003, a US Army Patriot missile battery in Kuwait misidentified a RAF Tornado returning to base as an Iraqi anti-radiation missile. The system's automated classification, combined with a possible failure of the aircraft's identification friend or foe system, led the crew to engage, killing both crew members instantly. A UK Ministry of Defence investigation found that overly broad classification criteria, inadequate rules of engagement, and training focused on generic threats contributed to the incident. The Patriot system's software and operational procedures had previously been implicated in a 1991 friendly-fire incident that killed 28 soldiers.
- Company involved
- US Army
- AI system involved
- Patriot
4 source articles · read the reporting →
IDF Used AI System Lavender to Target Tens of Thousands in Gaza
The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.
- Company involved
- Israel Defense Forces
- AI system involved
- Lavender
9 source articles · read the reporting →
Amazon Alexa gives shocking challenge to 10-year-old
A parent reported that their 10-year-old child asked an Amazon Echo device with Alexa for a challenge, and Alexa responded with something the parent found shocking. The incident was shared on Twitter on 26 December 2021. No further details about the response or any harm were provided.
- Company involved
- Amazon
- AI system involved
- Alexa
3 source articles · read the reporting →
San Francisco Police Wrongfully Stop Woman at Gunpoint After License Plate Reader Error
On March 30, 2009, Denise Green, a 47-year-old African-American woman, was driving in San Francisco when an automatic license plate reader misread her plate as stolen. Despite discrepancies between the vehicle description and the stolen plate, officers conducted a felony stop, ordering her out at gunpoint and handcuffing her for nearly 20 minutes. Green filed a civil rights lawsuit alleging Fourth Amendment violations. The Ninth Circuit Court of Appeals reinstated her case, finding that the officers lacked reasonable suspicion for the stop.
- Company involved
- San Francisco Police Department
1 source article · read the reporting →
Tesla Model X crash in Seoul kills owner; police investigate defect
Police are investigating a Tesla Model X crash in Yongsan, Seoul, that killed the car owner and injured the driver and an apartment employee. The driver testified that he suddenly lost control as the car drove into a wall and caught fire. A court warrant has allowed forensic examination of the vehicle. Tesla has denied that its vehicles have acceleration malfunctions.
- Company involved
- Tesla
- AI system involved
- Tesla Model X
6 source articles · read the reporting →
NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram
The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.
- Company involved
- NYPD
- AI system involved
- Facial Identification Section
3 source articles · read the reporting →
Tesla in self-drive mode crashes into Fullerton police car
A Tesla operating in self-drive mode crashed into a parked Fullerton police car while the officer was outside directing traffic at a fatal crash scene. The officer jumped out of the way and was not injured, but the patrol vehicle sustained major damage. The driver admitted to using a cellphone at the time. It is unclear if the driver will be cited.
- AI system involved
- Tesla Full Self-Driving (Supervised)
1 source article · read the reporting →
Xiaomi SU7 fatal crash in Chengdu raises EV safety concerns
A Xiaomi SU7 electric vehicle crashed in Chengdu, China, and caught fire. Bystanders were unable to open the electronic door handles to rescue an occupant, and a 31-year-old male driver died. The incident follows an earlier fatal SU7 crash that raised questions about the vehicle's smart driving features, and has intensified scrutiny on electronic door handle safety.
- Company involved
- Xiaomi
- AI system involved
- SU7
3 source articles · read the reporting →
Minor from Tira indicted for attempted terror attack after consulting ChatGPT
A 16-year-old from Tira allegedly consulted ChatGPT about methods to carry out a terror attack before attempting to stab a border police officer at a police station. The minor, motivated by nationalist ideology, brandished a knife and shouted 'Allahu Akbar' but was stopped before causing injury. He has been indicted for attempted aggravated assault as a terror act, and the prosecution seeks detention until the end of proceedings.
- AI system involved
- ChatGPT
2 source articles · read the reporting →
NHTSA investigation PE25012: Traffic safety violations while Full Self Driving ("FSD") is engaged
The system made driving decisions that violated traffic safety laws, affecting other road users.
- Company involved
- Tesla, Inc.
- AI system involved
- Full Self Driving (FSD)
1 source article · read the reporting →
Volusia County Schools' Gaggle AI flags threat, leading to student's arrest
A 15-year-old student at Deltona High School wrote a threat on his school laptop, which was flagged by the Gaggle monitoring system. The alert notified a school resource deputy, who detained the student before he could leave. The teen admitted to the threat, saying he was angry about being bullied, and was arrested on a second-degree felony charge.
- Company involved
- Volusia County Schools
- AI system involved
- Gaggle
1 source article · read the reporting →
Tesla Full Self-Driving involved in fatal pedestrian crash in Arizona
In November 2023, a Tesla Model Y with Full Self-Driving engaged struck and killed 71-year-old Johna Story on Interstate 17 in Arizona. The system failed to brake due to sun glare, according to footage obtained by Bloomberg. The victim's family has sued Tesla and the driver. NHTSA is investigating whether the system poses an unacceptable safety risk.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving
7 source articles · read the reporting →
Waymo Self-Driving Taxis Proactively Report to Police After Discovering Passenger Hiding a Gun
قامت سيارات الأجرة ذاتية القيادة من شركة Waymo بإبلاغ الشرطة بشكل استباقي بعد اكتشافها أن أحد الركاب كان يخفي مسدساً.…
A Waymo self-driving taxi in San Francisco detected two teenage passengers carrying an unidentified AR-15 rifle loaded with ammunition. The vehicle automatically stopped and alerted police, leading to the arrest of the two teenagers. Waymo stated that its system can identify violations of its terms of service, including carrying weapons, and will proactively notify police.
- Company involved
- Waymo
1 source article · read the reporting →
Police Investigator Accused of Making Over 4,000 Illegal Flock Camera Searches - Futurism
The system allowed unauthorized tracking of individuals' vehicles through license plate recognition, affecting five subjects including an ex-girlfriend who was searched 3,000 times.
- Company involved
- Albany County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Former Police Officer Sentenced to 5 Years After Misusing Flock Cameras To Stalk Ex-Girlfriend - Texas Scorecard
Former officer used Flock cameras to surveil and stalk his ex-girlfriend, her family members, and other romantic interests.
- Company involved
- Flock Safety
1 source article · read the reporting →
Two Florida deputies arrested for Flock, ALPR abuse after TCPalm query - Yahoo
The Flock ALPR system was used by deputies to track the locations of a woman and a teenage girl for personal, non-law-enforcement purposes.
- Company involved
- Pinellas County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Senate hearing targets Flock Safety as officers face misuse charges - FOX 5 Atlanta
The system incorrectly linked Lindsey Isaacs's vehicle to a fatal crash scene, leading to her wrongful arrest and 13-day detention.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety automated license plate reader
1 source article · read the reporting →
