Ex-Pikesville athletic director used AI deepfake to impersonate principal
Dazhon Darien, former athletic director at Pikesville High School, used artificial intelligence to create a deepfake audio clip in 2024 that made it appear as though principal Eric Eiswert made racist and antisemitic comments. The clip spread widely online, severely damaging Eiswert's reputation. Darien was arrested and later pleaded guilty to unrelated child sex crimes. Eiswert sued Baltimore County Public Schools and reached a settlement.
- Company involved
- Baltimore County Public Schools
7 source articles · read the reporting →
Dahua Exposed for Uyghur Tracking Software in Surveillance Systems
Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.
- Company involved
- Dahua Technology
- AI system involved
- Dahua SDK
1 source article · read the reporting →
US Secret Service bought access to cellphone location data
The US Secret Service signed a contract to access Locate X, a service that aggregates location data from phone apps and allows law enforcement to track devices without a warrant. The contract with Babel Street was worth about $36,000 and ran from 2017 to 2018. A former employee said the Secret Service used Locate X in 2018 to seize illegal credit card skimmers at petrol stations. Lawmakers and civil liberties advocates criticised the practice, and Senator Ron Wyden introduced a bill to ban such purchases.
- Company involved
- United States Secret Service
- AI system involved
- Locate X
1 source article · read the reporting →
Disney sends cease and desist to Character.AI over copyright
Walt Disney Company sent a cease and desist letter to Character.AI, alleging that the chatbot developer uses Disney's copyrighted characters without authorization. Disney expressed concern that the platform could damage its brand long term. The letter demands immediate action to stop using the characters.
- Company involved
- Character.AI
- AI system involved
- Character.AI
5 source articles · read the reporting →
Apple sued for $1 billion after facial recognition allegedly misidentifies teen as thief
Ousmane Bah, an 18-year-old student, alleges that Apple and its security firm used facial recognition software to incorrectly identify him as a shoplifter in multiple Apple Store thefts. He was arrested at his home and missed school, causing emotional distress and academic harm. While charges in New York and Boston were dropped after a detective noted Bah looked nothing like the suspect, a case in New Jersey remains pending. Apple denies using facial recognition in its stores, but the lawsuit claims the technology was used by its security contractor.
- Company involved
- Apple
5 source articles · read the reporting →
Israel Used AI Audio Tool to Target Hamas Commander, Killing Over 125 Civilians
In October 2023, Israel's Unit 8200 used an AI-powered audio tool to locate Hamas commander Ibrahim Biari in Gaza. The tool provided an approximate location based on his phone calls, leading to airstrikes on October 31 that killed Biari and over 125 civilians, according to Airwars. The incident is part of Israel's broader use of AI in the Gaza war, including facial recognition and target compilation. The civilian casualties highlight the fatal consequences of AI-driven military targeting.
- Company involved
- Israel Defense Forces
3 source articles · read the reporting →
NYPD Used Facial Recognition to Target Black Lives Matter Activist Derrick Ingram
The NYPD used facial recognition technology to identify Derrick Ingram, a 28-year-old Black Lives Matter activist, leading to a raid on his Hell's Kitchen apartment by over 50 officers on 7 August 2020. The NYPD's Facial Identification Section generated a lead from a photo taken from Ingram's Instagram page, despite the department's policy of using only surveillance video or arrest photos. Ingram's attorney alleges the five-hour siege was an intimidation campaign that interfered with his constitutional rights. The NYPD acknowledged using facial recognition as a limited investigative tool.
- Company involved
- NYPD
- AI system involved
- Facial Identification Section
3 source articles · read the reporting →
Clearview AI settles with ACLU over facial recognition database sales
Clearview AI has agreed to stop selling its facial recognition database to most private US companies as part of a proposed settlement with the ACLU. The company scraped billions of images from social media without consent to build its database, violating Illinois' Biometric Information Privacy Act. The settlement requires Clearview to delete old facial vectors and allow Illinois residents to opt out. The company can still sell its technology to law enforcement and government agencies.
- Company involved
- Clearview AI
- AI system involved
- Clearview AI facial recognition database
8 source articles · read the reporting →
Minor arrested in Palma for AI-generated nude images of schoolmates
A minor in Palma was arrested for allegedly using an AI application to generate realistic nude images of five female schoolmates from their clothed social media photos. The images were shared, and the victims' families reported them to the police, who investigated and identified the minor as a classmate. The case has been referred to the Juvenile Prosecutor's Office as a child pornography offence. The police noted that the images appeared real at first glance.
10 source articles · read the reporting →
Delhi Government uses facial recognition on children in government schools
The Delhi Government's Education Department is using facial recognition technology in conjunction with CCTV cameras in government schools, according to responses to RTI requests filed by the Internet Freedom Foundation. The organisation urged the Delhi Commission for Protection of Child Rights to intervene, alleging that the practice violates children's right to privacy and education under the Indian Constitution. No specific incident of harm has been reported, but the organisation warns of potential misidentification and disproportionate penalties.
- Company involved
- Government of NCT of Delhi, Education Department
10 source articles · read the reporting →
Macy's and Sunglass Hut facial recognition misidentifies man, leading to wrongful jailing
Harvey Eugene Murphy Jr was misidentified by facial recognition software used by Sunglass Hut and Macy's as the perpetrator of an armed robbery. He was arrested and jailed, where he alleges he was beaten and raped. His alibi was later confirmed and charges were dropped. He is suing the companies for $10 million in damages.
- Company involved
- Macy's and EssilorLuxottica
3 source articles · read the reporting →
ICE Agents Stored Photos and License Plates of Protest Observers in Palantir-Built Database, Court Filing Reveals - Latin Times
A court filing alleges ICE agents stored photos and license plates of protest observers in a Palantir-built database, labeled some of them as threats, and ran facial recognition searches on them.
- Company involved
- U.S. Immigration and Customs Enforcement (ICE)
- AI system involved
- ICM (Investigative Case Management system)
1 source article · read the reporting →
Docomo Pacific CEO's mother targeted in AI voice cloning scam
Docomo Pacific's CEO Christine Baleto revealed that her elderly mother received a scam call from someone impersonating a federal agent, using AI voice cloning to pressure her into revealing personal information. The caller threatened to send agents to her home if she did not comply. Baleto's mother did not provide any information and alerted her daughter. Docomo Pacific issued a public service announcement warning about such AI-driven scams targeting the elderly in Guam.
2 source articles · read the reporting →
Miami Police Used Clearview AI to Identify Protester
NBC 6 Investigators revealed that Miami Police used the facial recognition program Clearview AI to identify Oriana Albornoz, a 25-year-old woman, as the person accused of throwing rocks at officers during a protest on May 30, 2020. She was arrested a month later and charged with battery on a police officer; her attorney said he was unaware police had used the technology, as it was not disclosed in the arrest report. The police department acknowledged using Clearview AI to identify violent protest suspects after the fact, but stated they do not surveil peaceful protesters. The case is ongoing, with Albornoz pleading not guilty.
- Company involved
- Miami Police Department
- AI system involved
- Clearview AI
4 source articles · read the reporting →
CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…
The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.
- Company involved
- Christopher Day
1 source article · read the reporting →
Jamia Millia student among 4 held for using AI deepfakes to extort money from NRI - The Times of India
Generated deepfake sexually explicit videos to extort money from an NRI
1 source article · read the reporting →
Temple Police officer resigns after internal investigation into misuse of Flock Safety automatic license plate reader system - tdtnews.com
An officer conducted an unauthorized search of the Flock Safety automatic license plate reader system without a legitimate law enforcement purpose.
- Company involved
- Temple Police Department
- AI system involved
- Flock Safety automatic license plate reader (ALPR) system
1 source article · read the reporting →
Fort Myers man falsely arrested; lawsuit says AI program is to blame - WINK News
Police falsely arrested an innocent man due to a facial recognition misidentification
- Company involved
- Jacksonville Beach Police Department
- AI system involved
- FACESNXT
1 source article · read the reporting →
Lawsuit claims facial recognition program led to wrongful arrest - FOX 2
Identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17 months in jail.
- Company involved
- St. Louis County Police Department
- AI system involved
- Rekognition
1 source article · read the reporting →
AI-NOMIS data breach exposes thousands of AI-generated deepfake images
Cybersecurity researcher Jeremiah Fowler discovered a non-password-protected database belonging to South Korean AI company AI-NOMIS, containing nearly 100,000 records of AI-generated explicit images, including what appeared to be child sexual abuse material. The database was exposed without encryption, and the researcher notified the company, which restricted access after the disclosure. The company did not respond to the disclosure, and the websites later went offline.
- Company involved
- AI-NOMIS
- AI system involved
- GenNomis
5 source articles · read the reporting →
NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles
Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users
- Company involved
- Zoox
- AI system involved
- Zoox vehicle
1 source article · read the reporting →
Jacksonville supermarket assistant manager arrested after faulty AI facial-recognition match
The system identified an innocent man as a suspect, leading to his arrest for attempting to solicit a child
- Company involved
- Jacksonville Sheriff's Office
- AI system involved
- FACESNXT
1 source article · read the reporting →
Cybercheck AI tool challenged in Akron homicide cases
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
- Company involved
- Akron Police Department
- AI system involved
- Cybercheck
3 source articles · read the reporting →
Del Biaggio v. Bansen (CA California (4d)): AI-hallucinated content in court filing, Monetary Sanction
The AI generated fake legal citations that were included in an appellate brief, affecting the court and the client.
- Company involved
- Carlton Floyd
1 source article · read the reporting →
