Dutch police warn of AI prank calls over fake homeless intruders
Dutch police report that children used AI to generate fake videos of homeless intruders in their homes. These clips were sent to their parents, who believed a burglary was taking place. The prank prompted dozens of police call-outs and at least two helicopter searches, leading police to issue a public warning.
- Company involved
- Dutch police
1 source article · read the reporting →
West Midlands Police test NDAS system to assess crime risk
West Midlands Police are testing a system called the National Data Analytics Solution (NDAS) that analyses police data to assess the risk of individuals committing a crime or becoming a victim. The Home Office has funded the project with millions of pounds, intending to roll it out across England and Wales. Critics warn that the system could reinforce bias against minorities and undermine the presumption of innocence. The police say the technology is designed to support, not replace, officer decision-making and that it is still in early testing.
- Company involved
- West Midlands Police
- AI system involved
- National Data Analytics Solution
1 source article · read the reporting →
Brainwash cafe customers unknowingly put in AI surveillance dataset
In 2014, customers at the Brainwash Cafe in San Francisco were recorded by a publicly available webcam. The images were compiled into a dataset containing 11,917 photos for training surveillance-related object and head detection algorithms. The dataset was later removed from access following an investigation revealing use by researchers affiliated with the National University of Defense Technology in China. The dataset's creators are accused of collecting the images without the cafe customers' knowledge or consent.
- Company involved
- Stanford University
- AI system involved
- Brainwash dataset
1 source article · read the reporting →
Whiteside County deputy under investigation for possible Flock camera misuse - WQAD
Whiteside County deputy under investigation for possible Flock camera misuse WQAD
- Company involved
- Whiteside County Sheriff's Office
- AI system involved
- Flock camera
1 source article · read the reporting →
Las Vegas police used unsuitable facial recognition images in nearly half of searches
The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.
- Company involved
- Las Vegas Metropolitan Police Department
- AI system involved
- Vigilant Solutions facial recognition system
1 source article · read the reporting →
Deepfake video of ITV journalist Mary Nightingale promotes investment scam
In February 2024, a deepfake video of ITV News presenter Mary Nightingale appeared on social media. The manipulated 45-second clip showed Nightingale apparently presenting the ITV Evening News before promoting a fraudulent investment app. The video was deleted shortly after it was posted. Nightingale said she was "livid" and described the incident as identity theft.
6 source articles · read the reporting →
NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram
The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.
- Company involved
- NYPD
- AI system involved
- Facial Identification Section
3 source articles · read the reporting →
Minor arrested in Palma for AI-generated nude images of schoolmates
A minor in Palma was arrested for allegedly using an AI application to generate realistic nude images of five female schoolmates from their clothed social media photos. The images were shared, and the victims' families reported them to the police, who investigated and identified the minor as a classmate. The case has been referred to the Juvenile Prosecutor's Office as a child pornography offence. The police noted that the images appeared real at first glance.
10 source articles · read the reporting →
Delhi Government uses facial recognition on children in government schools
The Delhi Government's Education Department is using facial recognition technology in conjunction with CCTV cameras in government schools, according to responses to RTI requests filed by the Internet Freedom Foundation. The organisation urged the Delhi Commission for Protection of Child Rights to intervene, alleging that the practice violates children's right to privacy and education under the Indian Constitution. No specific incident of harm has been reported, but the organisation warns of potential misidentification and disproportionate penalties.
- Company involved
- Government of NCT of Delhi, Education Department
10 source articles · read the reporting →
Oklahoma judge admitted to citing fake ChatGPT cases in court order, investigators say - FOX40
The court denied a parent's motion for a psychological evaluation of the other parent, citing non-existent case law.
- Company involved
- Oklahoma District Court, Stephens County
- AI system involved
- ChatGPT
1 source article · read the reporting →
Sentence tossed after man killed in 2021 "speaks" in AI video shown in Arizona court - CBS News
The AI-generated video of the victim was presented to the judge, potentially influencing the 10-year manslaughter sentence imposed on Gabriel Paul Horcasitas.
1 source article · read the reporting →
Sheriff's investigator accused of spying on ex using Flock cameras - USA Today
An Albany County Sheriff's Office investigator is accused of using Flock license-plate cameras to track the vehicles of five people, including the investigator's ex-girlfriend, without a lawful purpose.
- Company involved
- Albany County Sheriff's Office
- AI system involved
- Flock Safety
1 source article · read the reporting →
ICE Agents Stored Photos and License Plates of Protest Observers in Palantir-Built Database, Court Filing Reveals - Latin Times
A court filing alleges ICE agents stored photos and license plates of protest observers in a Palantir-built database, labeled some of them as threats, and ran facial recognition searches on them.
- Company involved
- U.S. Immigration and Customs Enforcement (ICE)
- AI system involved
- ICM (Investigative Case Management system)
1 source article · read the reporting →
True Crime Case Files YouTube channel exposed for AI-generated fake true crime stories
The YouTube channel True Crime Case Files, which launched in late 2023, gained millions of views with videos purporting to be true crime documentaries. An investigation by the Denver Post revealed that the stories, including one about a murder in Littleton, Colorado, were entirely fabricated and likely generated by AI. The channel did not disclose that the cases were not real, leading viewers to believe they were genuine. Experts warned that such AI-generated misinformation is a growing problem, with the channel potentially earning tens of thousands of dollars from the deceptive content.
- Company involved
- True Crime Case Files
- AI system involved
- True Crime Case Files
5 source articles · read the reporting →
Miami Police Used Clearview AI to Identify Protester
NBC 6 Investigators revealed that Miami Police used the facial recognition program Clearview AI to identify Oriana Albornoz, a 25-year-old woman, as the person accused of throwing rocks at officers during a protest on May 30, 2020. She was arrested a month later and charged with battery on a police officer; her attorney said he was unaware police had used the technology, as it was not disclosed in the arrest report. The police department acknowledged using Clearview AI to identify violent protest suspects after the fact, but stated they do not surveil peaceful protesters. The case is ongoing, with Albornoz pleading not guilty.
- Company involved
- Miami Police Department
- AI system involved
- Clearview AI
4 source articles · read the reporting →
Police Investigator Accused of Making Over 4,000 Illegal Flock Camera Searches - Futurism
The system allowed unauthorized tracking of individuals' vehicles through license plate recognition, affecting five subjects including an ex-girlfriend who was searched 3,000 times.
- Company involved
- Albany County Sheriff's Office
- AI system involved
- Flock Safety ALPR
1 source article · read the reporting →
Former Police Officer Sentenced to 5 Years After Misusing Flock Cameras To Stalk Ex-Girlfriend - Texas Scorecard
Former officer used Flock cameras to surveil and stalk his ex-girlfriend, her family members, and other romantic interests.
- Company involved
- Flock Safety
1 source article · read the reporting →
Hackers Extract Encryption Keys from Flock Surveillance Cameras, Revealing Person Detection Alongside Vehicle Tracking - finance.biggo.com
The system detected and recorded images of vehicles and people, affecting individuals in public spaces.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety ALPR cameras
1 source article · read the reporting →
Oakland County investigating alleged misuse of Flock camera data by former deputy - WXYZ 7 News Detroit
The Flock camera system collected and stored license plate data, and a former deputy allegedly accessed it without authorization.
- Company involved
- Oakland County Sheriff's Office
- AI system involved
- Flock camera
1 source article · read the reporting →
Fort Myers man falsely arrested; lawsuit says AI program is to blame - WINK News
Police falsely arrested an innocent man due to a facial recognition misidentification
- Company involved
- Jacksonville Beach Police Department
- AI system involved
- FACESNXT
1 source article · read the reporting →
Hallucination-laced TRO raises alarm bells on AI use by courts - Massachusetts Lawyers Weekly
A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.
- Company involved
- U.S. District Court for the Southern District of Mississippi
1 source article · read the reporting →
Lawsuit claims facial recognition program led to wrongful arrest - FOX 2
Identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17 months in jail.
- Company involved
- St. Louis County Police Department
- AI system involved
- Rekognition
1 source article · read the reporting →
NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles
Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users
- Company involved
- Zoox
- AI system involved
- Zoox vehicle
1 source article · read the reporting →
Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.
Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.
- Company involved
- Sports Direct
- AI system involved
- Facewatch
2 source articles · read the reporting →