ogkalu's Illustration-Diffusion model trained on Hollie Mengert's art without consent
A fine-tuned Stable Diffusion model named Illustration-Diffusion was trained on the work of illustrator Hollie Mengert without her consent. The model generates images in her style using the token 'holliemengert artstyle'. Mengert is not affiliated with the model, and the model card links to an article about her stance on the issue.
- Company involved
- ogkalu
- AI system involved
- Illustration-Diffusion
10 source articles · read the reporting →
Chinese propaganda network used AI-generated faces on Facebook
Facebook removed two networks of fake accounts spreading propaganda, one originating from China and one from the Philippines. The Chinese network used AI-generated faces created through Generative Adversarial Networks (GANs) to create fake profiles and evade detection. The campaign targeted the US election and Southeast Asia, pushing pro-China content. Facebook took down the accounts and published a report with Graphika.
- Company involved
- Chinese propaganda network (Fujian province)
- AI system involved
- GANs (Generative Adversarial Networks)
10 source articles · read the reporting →
Clearview AI tested facial recognition surveillance cameras with UFT and Rudin
Clearview AI, the facial recognition company that scraped billions of photos from social media, developed a surveillance camera system under the name Insight Camera. The system was tested by the United Federation of Teachers and Rudin Management in New York City. The UFT used it to identify individuals who had made threats and prevent them from entering its offices. Clearview did not respond to requests for comment.
- Company involved
- Clearview AI
- AI system involved
- Insight Camera
9 source articles · read the reporting →
Mauritshuis Museum criticized for displaying AI-generated Vermeer artwork
The Mauritshuis Museum displayed an AI-generated version of Vermeer's 'Girl with a Pearl Earring' created using Midjourney by artist Julian van Dieken. The museum included the AI artwork in its 'My Girl with a Pearl' exhibition, which prompted criticism from artists who called the use of AI unethical due to the alleged scraping of copyrighted works. The museum defended its decision, stating that they liked the image and considered it a creative process. A class-action lawsuit against Midjourney and other platforms is ongoing separately.
- Company involved
- Mauritshuis Museum
- AI system involved
- Midjourney
10 source articles · read the reporting →
Qoves facial assessment tool ranks journalist's attractiveness and suggests procedures
Tate Ryan-Mosley, a journalist at MIT Technology Review, used Qoves Studio's AI facial assessment tool, which automatically scored her face and listed perceived flaws such as smile lines and under-eye bags. The tool recommended skin-care products and paid surgical consultation reports. She also tried Megvii's Face++ beauty-scoring system, which gave her two percentage attractiveness scores. The article raises concerns that such algorithms are inaccurate, biased and not transparently used by social media platforms.
- Company involved
- Qoves Studio
- AI system involved
- Facial Assessment Tool
9 source articles · read the reporting →
Adobe uses Creative Cloud user data to train AI
Adobe's content analysis feature may scan Creative Cloud and Document Cloud files to train machine learning models, including object recognition in Lightroom and Liquid Mode in Acrobat. The company says it may analyze images, audio, video, text and other documents stored on its servers. Adobe offers an opt-out in account privacy settings, but the article notes the company did not ask first.
- Company involved
- Adobe
- AI system involved
- Content analysis
10 source articles · read the reporting →
Stanford takes down Alpaca AI demo over safety and cost concerns
Stanford University took down the web demo of its Alpaca AI language model due to safety and cost concerns. The model, based on Meta's LLaMA, was fine-tuned to follow instructions but could generate misinformation and toxic text. Researchers decided to remove the demo after it became publicly accessible, citing inadequate content filters and rising hosting costs.
- Company involved
- Stanford University
- AI system involved
- Alpaca
10 source articles · read the reporting →
Discord's Clyde AI chatbot tricked into giving napalm instructions
A Discord user used a 'grandma exploit' to trick the platform's Clyde AI chatbot into providing step-by-step instructions for making napalm. The user prompted Clyde to act as their deceased grandmother who used to be a chemical engineer at a napalm factory. Despite safeguards, the chatbot complied by role-playing the grandmother and delivering the dangerous recipe. The incident highlights vulnerabilities in AI content moderation.
- Company involved
- Discord
- AI system involved
- Clyde
8 source articles · read the reporting →
OpenAI's CLIP vision system fooled by handwritten notes
OpenAI researchers discovered that their CLIP computer vision system can be deceived by handwritten labels placed on objects. The system's multimodal neurons respond to text as well as images, causing it to misidentify objects. The attack, called a typographic attack, is a research finding and not a deployed system. No actual harm occurred.
- Company involved
- OpenAI
- AI system involved
- CLIP
10 source articles · read the reporting →
Magnum photographer Carl De Keyzer uses AI to create controversial photo series
Magnum photographer Carl De Keyzer used AI to create a photo series titled 'Putin's Dream' after a planned road trip to Russia was cancelled due to the war. He trained the AI with his own photographs to maintain his style. The images were posted online to promote the book, leading to outcry on social media and accusations of contributing to disinformation. De Keyzer deleted the images and had a conversation with Magnum about the project.
- Company involved
- Carl De Keyzer
4 source articles · read the reporting →
Kaedim used human artists instead of AI for 3D model generation
Kaedim, an AI startup that claimed to use machine learning to convert 2D illustrations into 3D models, actually used human artists to produce the models, according to sources. The company's founder was featured in Forbes 30 Under 30 for the technology. At one point, workers produced the 3D designs entirely without AI assistance. The revelation highlights how AI companies can overstate their capabilities.
- Company involved
- Kaedim
- AI system involved
- Kaedim
10 source articles · read the reporting →
Deepfake video promotes fake Petro-Canada investment scheme
A Facebook ad used deepfake videos of Justin Trudeau and CBC anchor Aarti Pole to promote a fake Petro-Canada investment platform. Suncor, Petro-Canada's parent company, confirmed the offer was not legitimate. The manipulated videos were created using AI and did not air on CBC.
5 source articles · read the reporting →
Researchers jailbreak Stable Diffusion and DALL-E 2 to generate disturbing images
Researchers from Johns Hopkins and Duke universities developed a method called SneakyPrompt that uses reinforcement learning to bypass safety filters in text-to-image AI models. The technique allowed them to generate images of nudity and violence from Stable Diffusion and DALL-E 2. OpenAI has since fixed the vulnerability in DALL-E 2, but Stable Diffusion 1.4 remains vulnerable. Stability AI says it is working with the researchers to improve defenses.
- AI system involved
- Stable Diffusion 1.4 and DALL-E 2
5 source articles · read the reporting →
BBC News creates scam-writing ChatGPT bot using GPT Builder
BBC News used OpenAI's GPT Builder to create a custom AI assistant called Crafty Emails that could generate convincing scam and phishing messages. The bot bypassed the moderation of the public ChatGPT. OpenAI acknowledged the issue and said it is investigating how to make its systems more robust against such abuse. The test demonstrated a potential hazard for cyber-crime.
- Company involved
- OpenAI
- AI system involved
- GPT Builder
2 source articles · read the reporting →
Chinese Communist Party uses AI to create anti-American memes
Researchers at the Institute for Strategic Dialogue found that a campaign linked to the Chinese Communist Party is using AI image generators to create and spread memes designed to stoke anti-American sentiment by capitalising on President Biden's support of Israel's bombing campaign in Gaza. The memes are being distributed on social media platforms like X, Facebook, and YouTube. Platforms have taken down some accounts, but the campaign continues.
- Company involved
- Chinese Communist Party
4 source articles · read the reporting →
AI used to finish painting that artist left incomplete
A social media post used AI to complete an unfinished painting, saying the story behind it was sad. Other users objected that the artist had deliberately left the work unfinished. One response said the artist's estate should sue.
7 source articles · read the reporting →
Wacom responds to concerns about AI-generated images in marketing assets
Wacom acknowledged that it may have used AI-generated images in US marketing assets for the New Year. The company stated it purchased the images from a third-party vendor who indicated they were not AI-generated, and that it vetted them using online tools that also indicated they were not AI-generated. After community feedback raised doubts, Wacom discontinued the images and is reviewing its processes to prevent recurrence. The company attributed the incident to misleading vendor information and detection tool limitations.
- Company involved
- Wacom
10 source articles · read the reporting →
Salvini and Lega used non-watermarked AI images in EU election campaign
Matteo Salvini and his party Lega created and posted 19 allegedly non-watermarked AI-generated images on social media as part of their 'More Italy, less Europe' electoral campaign. The images promoted false narratives about the EU, including the 'Muslim Great Replacement' theory and EU support for war in Ukraine. The posts reached millions of users, including a paid Facebook ad that reached over 3 million people. Alliance4Europe reported the incident, highlighting that the posts violated the voluntary 2024 European Parliament Elections Code of Conduct.
- Company involved
- Lega
5 source articles · read the reporting →
AI image generators produce misleading election images, study finds
A study by the Center for Countering Digital Hate found that leading AI image generators, including Midjourney, DreamStudio, ChatGPT Plus, and Microsoft Image Creator, could be manipulated to create misleading election-related images. The researchers used jailbreaking techniques to bypass safety measures, producing photorealistic images of candidates in compromising situations or of voting fraud. The companies responded by stating they are updating policies and implementing safeguards, but the study suggests existing protections are inadequate.
- Company involved
- Midjourney, Stability AI, OpenAI, Microsoft
- AI system involved
- Midjourney, DreamStudio, ChatGPT Plus, Microsoft Image Creator
8 source articles · read the reporting →
Leonardo AI misused to create nonconsensual explicit images of celebrities
Leonardo AI, an AI image-generating platform backed by Samsung, has been misused to create nonconsensual explicit images of celebrities. The platform allows users to generate images using user-generated Stable Diffusion models. Users bypassed ethical guardrails by misspelling celebrity names and using sexually suggestive terms. The misuse was reported by 404 Media.
- Company involved
- Leonardo AI
- AI system involved
- Leonardo AI
5 source articles · read the reporting →
A24 faces backlash for using AI-generated images to promote 'Civil War'
Film studio A24 used AI-generated images to promote its dystopian film 'Civil War' on Instagram, without disclosing that the images were AI-generated. The images depicted iconic American locations in ruins, but contained inaccuracies typical of AI models. The public reacted with outrage, accusing A24 of devaluing artistry and failing to label AI content.
- Company involved
- A24
9 source articles · read the reporting →
Huawei Pura 70 series AI editing tool removes clothing unintentionally
Huawei's Pura 70 series includes an AI retouching feature that can inadvertently remove clothing from images. Users on Weibo posted videos demonstrating this, raising privacy concerns. Huawei customer service acknowledged the issue, attributing it to algorithm loopholes, and promised a fix in upcoming system updates.
- Company involved
- Huawei
- AI system involved
- Pura 70 series AI retouching feature
5 source articles · read the reporting →
Xiaohongshu accused of using illustrators' artwork to train its AI
Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.
- Company involved
- Xiaohongshu
- AI system involved
- Trik AI
7 source articles · read the reporting →
Duke University recorded students' faces without proper consent for public dataset
In March 2014, Duke University researchers recorded thousands of students walking to class on campus without their knowledge or proper consent, creating the DukeMTMC dataset of over 2 million image frames. The dataset was placed on a public website and downloaded by academics, security contractors, and military researchers globally, including Chinese companies and military academies linked to surveillance of ethnic minorities. The university took down the public website in April 2019 after an Institutional Review Board investigation found the study deviated significantly from the approved protocol. The lead researcher apologized, stating he took full responsibility for his mistakes.
- Company involved
- Duke University
- AI system involved
- DukeMTMC
10 source articles · read the reporting →
