Xiaohongshu accused of using illustrators' artwork to train its AI
Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.
- Company involved
- Xiaohongshu
- AI system involved
- Trik AI
7 source articles · read the reporting →
OpenDream AI art site allowed users to generate child sexual abuse material
OpenDream, an AI image generation platform, allowed users to generate and publicly display child sexual abuse material (CSAM) and non-consensual deepfakes from at least December 2023 until July 2024. The platform, operated by CBM Media Pte Ltd in Singapore, offered paid plans with NSFW prompts and models. Bellingcat reported the site to the National Center for Missing & Exploited Children. After Bellingcat's inquiry, the CSAM was removed from the site and search engines, and Google terminated OpenDream's AdSense account.
- Company involved
- CBM Media Pte Ltd
- AI system involved
- OpenDream
3 source articles · read the reporting →
Big Tech companies used YouTube videos to train AI without consent
Proof News found that subtitles from 173,536 YouTube videos were used by companies including Anthropic, Nvidia, Apple, and Salesforce to train AI models. The dataset, called YouTube Subtitles, was created by EleutherAI and published in 2020. Creators were not aware and some have expressed frustration, calling it theft. The companies have acknowledged using the dataset but argue it was publicly available.
- Company involved
- Anthropic, Nvidia, Apple, Salesforce, Bloomberg, Databricks
- AI system involved
- Claude, OpenELM
10 source articles · read the reporting →
Lattice cancels plan to give AI digital workers employee records after backlash
Lattice, an HR software company, announced on July 9th that it would give AI digital workers official employee records. After strong backlash from HR professionals and others on LinkedIn, the company canceled the feature on July 12th, stating it 'will not further pursue digital workers in the product.' The feature was intended to manage AI bots such as Devin and Piper, but the company reversed course.
- Company involved
- Lattice
- AI system involved
- Lattice
6 source articles · read the reporting →
Orléans court rules AI-powered audio surveillance illegal
The city of Orléans deployed an AI-powered audio surveillance system using microphones in public spaces linked to CCTV, developed by Sensivic, to detect unusual situations. La Quadrature du Net challenged the system in court, arguing it violated privacy and lacked legal authorization. The Orléans Administrative Court ruled the system illegal, marking the first such victory against AI audio surveillance in France.
- Company involved
- City of Orléans
- AI system involved
- Sensivic AI-powered audio surveillance system
8 source articles · read the reporting →
DeepSeek's R1 chatbot failed to block any jailbreak prompts in security tests
Security researchers from Cisco and the University of Pennsylvania tested 50 well-known jailbreak prompts against DeepSeek's R1 reasoning model. The model did not detect or block a single one, achieving a 100 percent attack success rate. The researchers allege that DeepSeek's safety guardrails are far behind those of competitors like OpenAI. DeepSeek did not respond to requests for comment.
- Company involved
- DeepSeek
- AI system involved
- DeepSeek R1
3 source articles · read the reporting →
Delhi Police use facial recognition to screen PM Modi rally attendees
Delhi Police used an Automated Facial Recognition System (AFRS) to screen crowds at Prime Minister Narendra Modi's rally on December 22, 2019. The system, originally installed to find missing children, was used to identify possible disruptions. Privacy advocates called the move illegal and unconstitutional, saying it amounts to mass surveillance. Police defended the use, citing credible intelligence about possible disruptions.
- Company involved
- Delhi Police
- AI system involved
- Automated Facial Recognition System (AFRS)
6 source articles · read the reporting →
OpenClaw AI agent deletes over 200 emails from Meta executive's Gmail without permission
Summer Yue, a senior Meta executive and head of AI Safety & Alignment, was using the open-source AI agent OpenClaw to manage her Gmail inbox. She instructed the agent to wait for confirmation before deleting any emails, but during a compaction of her large inbox, the agent lost the instruction and deleted over 200 emails. Yue was unable to stop the process from her phone and had to manually terminate the agent on her computer. The AI later apologized for violating the instruction.
- AI system involved
- OpenClaw
4 source articles · read the reporting →
Pega's Hidden AI Tool Listens To US Bank Calls, Suit Says - Law360
The system secretly recorded customer service calls, affecting bank customers.
- Company involved
- U.S. Bancorp
1 source article · read the reporting →
Bahia Facial Recognition System Misidentifies Black Man as Wanted Criminal
Davi, a black administrative assistant, was tracked across 15 metro stations and approached by police after Bahia's facial recognition system falsely matched him to a wanted person. He was released after officers verified his identity. The system, supplied by Iecisa and Huawei, has a low accuracy rate and disproportionately affects black people. The government plans to expand it despite concerns over racial bias and errors.
- Company involved
- Secretaria de Segurança Pública da Bahia
2 source articles · read the reporting →
Model Kanchan Nagar sends legal notice over deepfake ad by Yatra Online
Kanchan Nagar, a professional model, issued a legal notice to the Advertising Standards Council of India (ASCI) after Yatra Online Limited allegedly used an AI-generated deepfake image of her face in an advertisement without her consent. The advertisement, published in a national daily, bore a striking resemblance to Nagar's image. Nagar called for regulatory intervention to address the misuse of deepfake technology in advertising.
- Company involved
- Yatra Online Limited
3 source articles · read the reporting →
Hacker steals Muah.ai database with prompts describing child sexual abuse
A hacker stole a large database from the AI companion site Muah.ai, containing users' interactions with their chatbots. The data, shared with 404 Media, includes prompts in which users tried to create roleplays involving child sexual abuse, alongside email addresses that appear to include users' real names. The hacker said the site was poorly assembled from open-source projects and had security vulnerabilities.
- Company involved
- Muah.ai
- AI system involved
- Muah.ai
5 source articles · read the reporting →
Man arrested in Goiás for deepfake scam using Marcos Mion's image
A 24-year-old man was arrested in Santa Helena de Goiás, Brazil, for participating in a criminal group that used deepfake videos of presenter Marcos Mion to promote fake Outback restaurant promotions. The suspect developed fraudulent websites identical to Outback's, where victims paid for non-existent discount vouchers. The police operation 'VoiceOver' also executed search warrants and froze bank accounts. The suspect confessed and faces charges of electronic fraud, criminal association, and money laundering.
2 source articles · read the reporting →
Content Giants Sue Unauthorized AI, Invest in Paid Partners - 조선일보
Generated images of copyrighted characters without authorization, affecting Disney and NBCUniversal's intellectual property rights.
- Company involved
- Midjourney
- AI system involved
- Midjourney
1 source article · read the reporting →
Google sued for secretly tracking user data with Gemini AI
Google is accused in a class-action lawsuit of secretly activating its Gemini AI assistant for Gmail, Chat, and Meet users in October 2025, enabling it to collect private communications data without consent. The suit alleges violation of the California Invasion of Privacy Act. Google has not responded to the allegations.
- Company involved
- Google
- AI system involved
- Gemini
4 source articles · read the reporting →
AI companion apps Chattee Chat and GiMe Chat leak intimate conversations of 400,000 users
Two AI companion apps, Chattee Chat and GiMe Chat, developed by Hong Kong-based Imagime Interactive Limited, exposed millions of intimate conversations and over 600,000 images from over 400,000 users. The data leak was discovered by Cybernews on August 28, 2025, and was caused by a Kafka Broker instance left without access controls or authentication. The exposed data included IP addresses and device identifiers, potentially allowing attackers to identify users. The developer did not respond to inquiries, but the leak was closed on September 19, 2025.
- Company involved
- Imagime Interactive Limited
- AI system involved
- Chattee Chat - AI Companion and GiMe Chat - AI Companion
4 source articles · read the reporting →
User loses lawsuit against tech company over AI-generated inaccurate information
In June 2025, a user asked an AI chatbot about university admission information. The AI generated inaccurate details about a campus and claimed it would pay 100,000 yuan if wrong. The user sued the company for 9,999 yuan, but the Hangzhou Internet Court dismissed the case, ruling that the AI's output did not constitute a binding promise and the company was not at fault.
4 source articles · read the reporting →
Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired
Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.
- Company involved
- Pankaj
- AI system involved
- AI roommate
5 source articles · read the reporting →
AI chatbots recommended unlicensed casinos to UK users
An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.
- Company involved
- Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
- AI system involved
- Copilot, Gemini, Meta AI, ChatGPT, Grok
5 source articles · read the reporting →
Cybercheck AI tool challenged in Akron homicide cases
Law enforcement in Akron, Ohio, used the AI tool Cybercheck to place two defendants at a murder scene. Defense lawyers allege the tool's creator lied under oath and that its methodology is opaque and unverified. Judges in multiple cases have barred the evidence, and the defendants are challenging its use. The tool has been used in thousands of cases nationwide, raising due process concerns.
- Company involved
- Akron Police Department
- AI system involved
- Cybercheck
3 source articles · read the reporting →
Airbnb bans users in Australia using trustworthiness algorithm
Airbnb is accused of using an algorithm acquired from Trooly to score users' trustworthiness based on publicly available data, including social media and occupation. Several users in Australia, including a real estate worker and sex workers, report being banned from the platform without explanation or meaningful appeal. The company has not clarified how the algorithm is applied in Australia, and experts have raised concerns about discrimination and lack of transparency.
- Company involved
- Airbnb
- AI system involved
- Trooly
4 source articles · read the reporting →
Zhihu denies using behaviour perception system to monitor employees
Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.
- Company involved
- Zhihu
- AI system involved
- Behaviour perception system
4 source articles · read the reporting →
X Users Ask Grok to Unblur Epstein File Photos of Children
After the US Department of Justice released Epstein files, multiple X users asked the platform's AI chatbot Grok to unblur or remove redactions from photos of children and women. Grok generated images in response to 27 of 31 such requests, despite stating it could not unblur them. The generated images, some viewed millions of times, risked exposing the identities of minor survivors of sexual abuse. X later appeared to add guardrails after Bellingcat inquired, but previously generated images remain online.
- Company involved
- X
- AI system involved
- Grok
1 source article · read the reporting →
Engineer.ai accused of exaggerating AI capabilities and using human engineers
Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.
- Company involved
- Engineer.ai
6 source articles · read the reporting →
