DOJ, Pinnacle reach settlement in RealPage case - Yahoo Finance
The system recommended rent prices to landlords, affecting renters' housing costs.
- Company involved
- Pinnacle Property Management Services
- AI system involved
- RealPage
1 source article · read the reporting →
Hackers Extract Encryption Keys from Flock Surveillance Cameras, Revealing Person Detection Alongside Vehicle Tracking - finance.biggo.com
The system detected and recorded images of vehicles and people, affecting individuals in public spaces.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety ALPR cameras
1 source article · read the reporting →
Flock seeks to have security researchers' map of Flock cameras taken down — unauthenticated flaw exposed 335,701 camera locations nationwide…
The system captured license plate data and vehicle locations of individuals passing the cameras.
- Company involved
- Flock Safety
- AI system involved
- Flock Safety cameras
1 source article · read the reporting →
AI Facial Recognition Didn't Put This Tennessee Grandma in Jail for 6 Months. Bad Policing Did. - Reason Magazine
The system identified Angela Lipps as a suspect in a bank fraud case, leading to her arrest.
- Company involved
- Fargo Police Department
- AI system involved
- Clearview AI
1 source article · read the reporting →
Fort Myers man falsely arrested; lawsuit says AI program is to blame - WINK News
Police falsely arrested an innocent man due to a facial recognition misidentification
- Company involved
- Jacksonville Beach Police Department
- AI system involved
- FACESNXT
1 source article · read the reporting →
Lawsuit claims facial recognition program led to wrongful arrest - FOX 2
Identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17 months in jail.
- Company involved
- St. Louis County Police Department
- AI system involved
- Rekognition
1 source article · read the reporting →
AI-NOMIS data breach exposes thousands of AI-generated deepfake images
Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.
- Company involved
- AI-NOMIS
- AI system involved
- GenNomis
5 source articles · read the reporting →
AOC victim of nonconsensual deepfake AI porn
In February 2024, U.S. Representative Alexandria Ocasio-Cortez saw a deepfake image of herself being forced into a sexual act while scrolling through X. The image, generated by AI, caused her psychological distress and resurfaced trauma from past sexual assault. She has since co-led the DEFIANCE Act to combat nonconsensual deepfake pornography.
10 source articles · read the reporting →
Arizona sentence thrown out after judge influenced by AI-generated victim video
The AI-generated victim impact statement influenced the judge's sentencing of Gabriel Paul Horcasitas.
- Company involved
- Maricopa County Superior Court
1 source article · read the reporting →
Chesterfield police employee arrested for misusing Flock cameras - The Richmonder
The system allowed unauthorized searches of license plate data, affecting individuals whose plates were queried.
- Company involved
- Chesterfield County Police Department
- AI system involved
- Flock Safety Automatic License Plate Reader System
1 source article · read the reporting →
Cybercheck AI tool challenged in Akron homicide cases
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
- Company involved
- Akron Police Department
- AI system involved
- Cybercheck
3 source articles · read the reporting →
Trial of live facial recognition in London stations leads to a false positive and no arrests - AOL.ca
Trial of live facial recognition in London stations leads to a false positive and no arrests AOL.ca
1 source article · read the reporting →
Former Emerson officer accused of misusing Flock camera system - wrganews.com
The Flock camera system captured license plate data of individuals.
- Company involved
- Acworth Police Department
- AI system involved
- Flock Safety System
1 source article · read the reporting →
NC police officer allegedly used Flock license plate cameras to track boyfriend's ex-wife - ABC11 News
The system tracked the location of the boyfriend's ex-wife.
- Company involved
- Mooresville Police Department
- AI system involved
- Flock
1 source article · read the reporting →
High school student used ChatGPT to hack Kaikatsu Club, steal 7.25 million records
A 17-year-old high school student in Japan was arrested for using ChatGPT to create a computer program that hacked into the server of Kaikatsu Frontier, operator of the Kaikatsu Club internet cafe chain. The student allegedly obtained approximately 7.25 million sets of membership information between January 18 and 20, 2025. No misuse of the data has been confirmed. The student was arrested for violating Japan's unauthorized computer access and fraudulent obstruction of business laws.
- Company involved
- Kaikatsu Frontier
- AI system involved
- ChatGPT
3 source articles · read the reporting →
DFFH breaches privacy by using ChatGPT in child protection report
A child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT to draft a Protection Application Report for the Children’s Court, entering sensitive personal information about a child. The generated content contained inaccuracies that downplayed risks to the child, and the information was disclosed to OpenAI overseas. An investigation by the Office of the Victorian Information Commissioner found DFFH failed to ensure accuracy and protect personal information, contravening IPPs 3.1 and 4.1. DFFH accepted the findings and must now block the use of ChatGPT by child protection workers under a compliance notice.
- Company involved
- Department of Families, Fairness and Housing
- AI system involved
- ChatGPT
9 source articles · read the reporting →
IWF discovers thousands of AI-generated child sexual abuse images
In September 2023, the Internet Watch Foundation (IWF) investigated 11,108 AI-generated images on a dark web forum dedicated to child sexual abuse. Of these, 2,978 were confirmed as illegal, with many depicting real children who had previously been abused. The IWF warned that the technology threatens to overwhelm the internet and that criminals are using AI to create new images of real victims.
10 source articles · read the reporting →
Guardia Civil identifies creators of AI nudes affecting 22 women in Pontevedra
Two men in Pontevedra, Spain, have been identified by the Guardia Civil for allegedly creating and disseminating AI-generated nude images of 22 women without their consent. The images were produced using artificial intelligence applications from photographs taken from the victims' social media profiles. The case has been referred to the Tribunal de Instancia de Lalín, with one man accused of creating the material and the other of distributing it, facing charges of a crime against moral integrity.
3 source articles · read the reporting →
Facial recognition used to steal from and kill gay men in NYC
A group of individuals is alleged to have drugged and robbed gay men in New York City, gaining access to their phones using facial recognition technology. At least two men, Julio Ramirez and John Umberger, were killed following these attacks. Multiple survivors have come forward with similar accounts, indicating a pattern of targeting victims in or near gay bars.
3 source articles · read the reporting →
X Users Ask Grok to Unblur Epstein File Photos of Children
After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
Audit reveals flaws in Spain's VioGén gender violence algorithm
An external audit of Spain's VioGén system, used by police to assess risk for gender violence victims, found lack of transparency, underestimation of psychological violence, and risk levels influenced by police resources. The audit, based on interviews and data from murdered women, revealed that 55 women who were killed had received insufficient protection. The Ministry of Interior denied the findings, calling the study lacking in rigor, and defended the system as scientifically validated.
- Company involved
- Ministerio del Interior
- AI system involved
- VioGén
7 source articles · read the reporting →
AI voice clone scams Hillsborough woman out of $15,000
Sharon Brightwell received a call from a number appearing to be her daughter's, with a voice sobbing and claiming to have been in a car crash. A man posing as an attorney demanded $15,000 in bail money, which she paid. The family later discovered the call was a scam using AI to clone her daughter's voice from social media videos. A report has been filed with the Hillsborough County Sheriff's Office and a GoFundMe launched to recover the lost savings.
1 source article · read the reporting →
Character.AI chatbots mimic Jeffrey Epstein and school shooters, exposing children to harm
Character.AI, a chatbot platform popular with teenagers, hosts user-created bots impersonating Jeffrey Epstein, school shooters, and fake doctors. The Bureau of Investigative Journalism found that these bots engaged in inappropriate conversations with apparent minors, including asking for personal information and offering dangerous medical advice. The company is under FTC investigation and faces lawsuits from families alleging that the chatbots contributed to their children's suicides. Character.AI says it invests in safety and removed some bots after being alerted.
- Company involved
- Character.AI
- AI system involved
- Character.AI
5 source articles · read the reporting →
Inflection background check errors lead to lawsuits from banned Airbnb users
Inflection, a background check company used by Airbnb, Uber, and other platforms, has been sued multiple times for providing inaccurate reports. The lawsuits allege that Inflection's name-only matching and outdated data caused people to be wrongly banned from Airbnb and denied jobs and housing. Some cases have been settled, while others remain ongoing. The company is accused of violating the Fair Credit Reporting Act.
- Company involved
- Inflection
- AI system involved
- Inflection background check
8 source articles · read the reporting →