AI news presenters James and Rose terminated after two months at Hawaii newspaper
The Garden Island newspaper in Hawaii deployed AI-generated news presenters James and Rose, created by Caledo, to produce video broadcasts. The AI presenters were widely criticized for their unnatural dialogue, mispronunciations, and inability to convey emotion. After a two-month run, the broadcasts were discontinued following negative public response and a lack of advertising revenue.
- Company involved
- Oahu Publications
- AI system involved
- James and Rose
8 source articles · read the reporting →
PimEyes facial recognition search engine identifies individuals from public photos
PimEyes, a Polish facial recognition search engine, allows users to upload a photo and find matching images from across the internet. The system scrapes billions of photos and creates biometric profiles without consent. A banker named Dylan (pseudonym) discovered that an old party photo of him was found by the system, potentially outing his private life. Privacy advocates and platforms like Instagram and YouTube are taking action against PimEyes, alleging violations of the GDPR.
- Company involved
- PimEyes
- AI system involved
- PimEyes
6 source articles · read the reporting →
Samsung settles Texas lawsuit over ACR data collection on smart TVs
Samsung has settled a lawsuit with the Texas Attorney General over its Automated Content Recognition (ACR) system on smart TVs. The system collected viewing data from users without informed consent. As part of the settlement, Samsung agreed to stop collecting ACR data from Texans without explicit consent and to rewrite its privacy prompts. Samsung also faces a federal class action in New York over similar allegations.
- Company involved
- Samsung
- AI system involved
- Automated Content Recognition (ACR)
7 source articles · read the reporting →
Google engineer claims LaMDA AI is sentient
Google engineer Blake Lemoine claimed that the company's LaMDA chatbot AI had become sentient. He based this on conversations with the system. Google placed him on paid leave and denied the claim. No harm to users was reported.
- Company involved
- Google
- AI system involved
- LaMDA
10 source articles · read the reporting →
Apple Intelligence generates false BBC news alert about suicide
On 13 December 2024, Apple's new generative AI feature, Apple Intelligence, generated a false news alert attributing it to the BBC, claiming the suicide of Luigi Mangione. The BBC complained to Apple. Reporters Without Borders (RSF) urged Apple to remove the feature, citing risks to reliable journalism.
- Company involved
- Apple
- AI system involved
- Apple Intelligence
7 source articles · read the reporting →
GoLaxy Used AI to Manipulate Public Opinion in Hong Kong and Taiwan
The Chinese company GoLaxy used an AI system called Smart Propaganda System (GoPro) to monitor and manipulate public opinion in Hong Kong and Taiwan, according to internal documents. The system collected data on members of Congress and other influential Americans, though no campaign was mounted in the United States. GoLaxy denied the allegations, calling them misinformation. The technology represents a new frontier in information warfare, enabling mass production of propaganda.
- Company involved
- GoLaxy
- AI system involved
- Smart Propaganda System (GoPro)
2 source articles · read the reporting →
Duke University MTMC Dataset Used in Authoritarian Surveillance Research
Duke University created and openly distributed the Duke MTMC dataset, containing surveillance footage of approximately 2,000 students and visitors on campus. The dataset was used by numerous organisations, including Chinese military-linked companies like SenseTime and Hikvision, for developing person re-identification and facial recognition technologies. Following an investigation by exposing.ai and the Financial Times, Duke University terminated the dataset in May 2019. The incident highlights the privacy risks of academic datasets being repurposed for mass surveillance without consent.
- Company involved
- Duke University
- AI system involved
- Duke MTMC
1 source article · read the reporting →
Adobe Firefly trained on thousands of Midjourney images, Bloomberg reports
Bloomberg has reported that Adobe's Firefly image generator was trained using thousands of images from competitor Midjourney. Adobe says these made up about 5% of the training data and were part of the Adobe Stock library. The company has marketed Firefly as ethically trained and offered enterprise customers indemnity against copyright claims. Adobe responded that all Adobe Stock images undergo moderation, but the report has raised questions about Firefly's copyright safety.
- Company involved
- Adobe
- AI system involved
- Firefly
7 source articles · read the reporting →
Meta Smart Glasses Lawsuit Claims Sex, Bathroom Footage Was Sent to Overseas AI Workers - Law Commentary
Recorded and transmitted private footage of users and bystanders to overseas AI workers
- Company involved
- Meta
- AI system involved
- Meta Smart Glasses
1 source article · read the reporting →
IDF Used AI System Lavender to Target Tens of Thousands in Gaza
The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.
- Company involved
- Israel Defense Forces
- AI system involved
- Lavender
9 source articles · read the reporting →
YouTube applies machine learning post-processing to Shorts without opt-out
YouTube announced an experiment on select Shorts using traditional machine learning to unblur, denoise, and improve clarity during processing. Creators reported that this altered their videos' appearance without an opt-out option, and some accused YouTube of misleading about the use of AI. YouTube acknowledged the experiment and said it would consider feedback, but did not offer a rollback or opt-out.
- Company involved
- YouTube
- AI system involved
- YouTube Shorts post-processing
7 source articles · read the reporting →
Xuhui police expand facial recognition surveillance to profile 1.1 million residents
The Xuhui District branch of the Shanghai Municipal Bureau of Public Security is expanding its Intelligent Image Recognition System, adding 2,500 facial recognition cameras and increased computing capacity to build profiles of residents and flag deviations. The project, contracted to US-sanctioned FiberHome, is designed to match each face to files on more than 50 million people. Officials say the system will analyse behaviour patterns and trigger early warnings.
- Company involved
- Shanghai Municipal Bureau of Public Security, Xuhui District Branch
- AI system involved
- Intelligent Image Recognition System
3 source articles · read the reporting →
Users jailbreak Luma Labs Dream Machine to generate porn
Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.
- Company involved
- Luma Labs
- AI system involved
- Dream Machine
3 source articles · read the reporting →
NYPD Facial Recognition Leads to Wrongful Arrest of Trevis Williams
In April 2025, Trevis Williams was arrested by the NYPD after a facial recognition program matched his mug shot to a suspect in a February flashing incident, despite an eight-inch height difference and alibi evidence. The victim identified him from the AI-suggested photo array. Mr. Williams spent over two days in jail before the case was dismissed in July. The incident highlights the risks of using facial recognition on low-quality surveillance images.
- Company involved
- New York Police Department
2 source articles · read the reporting →
Dahua Exposed for Uyghur Tracking Software in Surveillance Systems
Dahua Technology's publicly available SDK was found to contain code for detecting Uyghur ethnicity, enabling Chinese police to covertly track the persecuted minority. The revelation led to widespread criticism, and Dahua removed the SDK after being contacted by IPVM but did not comment. The company had previously been sanctioned by the US for complicity in human rights abuses against Uyghurs, and its software is part of a massive surveillance apparatus in Xinjiang.
- Company involved
- Dahua Technology
- AI system involved
- Dahua SDK
1 source article · read the reporting →
Las Vegas police used unsuitable facial recognition images in nearly half of searches
The Las Vegas Metropolitan Police Department (LVMPD) used 'non-suitable' probe images in 451 of 924 facial recognition searches in 2019, greatly increasing the risk of false identifications. The system, supplied by Vigilant Solutions, returned likely matches in only 18% of those searches, yet led to arrests in at least 73 cases. Critics and researchers warn this practice heightens the chance of wrongful arrests, and one defence attorney said he was never informed facial recognition was used to identify his client.
- Company involved
- Las Vegas Metropolitan Police Department
- AI system involved
- Vigilant Solutions facial recognition system
1 source article · read the reporting →
Adobe Stock creators say Firefly trained on their images without consent
Adobe Stock contributors allege that Adobe trained its Firefly generative AI model on their stock images without express notification or consent. They say Firefly's popularity is reducing demand for their stock photos and flooding the platform with AI-generated images. Adobe says Firefly is still in beta and it is committed to compensating creators, with details to come when generally available.
- Company involved
- Adobe
- AI system involved
- Adobe Firefly
1 source article · read the reporting →
Macy's and Sunglass Hut facial recognition misidentifies man, leading to wrongful jailing
Harvey Eugene Murphy Jr was misidentified by facial recognition software used by Sunglass Hut and Macy's as the perpetrator of an armed robbery. He was arrested and jailed, where he alleges he was beaten and raped. His alibi was later confirmed and charges were dropped. He is suing the companies for $10 million in damages.
- Company involved
- Macy's and EssilorLuxottica
3 source articles · read the reporting →
AI image generation triggers psychosis in startup employee
Caitlin Ner, head of user experience at an unnamed AI image generation startup, spent up to nine hours a day generating AI images of herself. Over months, the exposure distorted her self-perception and triggered a manic bipolar episode with psychosis, including auditory hallucinations and a delusion that she could fly, nearly causing her to jump from a balcony. She left the startup, sought therapy, and recovered. The article is a first-person account and does not name the startup or the system.
2 source articles · read the reporting →
New Meta smart glasses class action gives employers a reason to write the policy they've been puttin - hcamag.com
The smart glasses recorded bystanders without their consent and sent the footage to Meta for AI training.
- Company involved
- Meta Platforms
- AI system involved
- Meta AI-enabled Ray-Ban and Oakley smart glasses
1 source article · read the reporting →
Hallucination-laced TRO raises alarm bells on AI use by courts - Massachusetts Lawyers Weekly
A generative AI tool drafted a temporary restraining order in Jackson Federation of Teachers v. Fitch containing fabricated parties, declarations, and statutory language, affecting the state of Mississippi and the plaintiffs.
- Company involved
- U.S. District Court for the Southern District of Mississippi
1 source article · read the reporting →
Lawsuit claims facial recognition program led to wrongful arrest - FOX 2
Identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17 months in jail.
- Company involved
- St. Louis County Police Department
- AI system involved
- Rekognition
1 source article · read the reporting →
Mr Craig Hadley wrongly accused of fraud at Sports Direct shop using Facewatch facial recognition.
Mr Craig Hadley was wrongly accused of being a fraudster at a Rotherham Sports Direct shop using facial recognition technology supplied by Facewatch. The system flagged him as a known fraudster, but the alert was later attributed to human error. Big Brother Watch, a privacy campaign group, has raised concerns about the lack of due process in such systems.
- Company involved
- Sports Direct
- AI system involved
- Facewatch
2 source articles · read the reporting →
Evolv backtracks on claimed UK government testing of AI weapons scanner
Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.
- Company involved
- Evolv Technology
- AI system involved
- Evolv Express
3 source articles · read the reporting →
