Hollie Mengert art used to train Illustration Diffusion
Illustrator Hollie Mengert discovered that her online art portfolio was used to train Illustration Diffusion, a text-to-image model created by Canada-based Nigerian engineering student Ogbogu Kalu , without her permission. Kalu used 32 of Mengert's illustrations to fine-tune Stable Diffusion to recreate the illustrator's style using Google's DreamBooth, a technique for introducing new subjects to a pretrained text-to-image diffusion model. She then released the model on Hugging Face under an open license for anyone to use. The act triggered a heated debate about the ethics and legality of using artwork developed and owned by other people or organisations without their consent. Mengert pointed out that she was in no position to grant Kalu permission to train his model on her work even if she wanted to as her work involves characters owned by corporations like Disney or Penguin Random House. On the other hand, Kalu said he thinks his act was legal and 'likely to be determined fair use in court'. He reckoned it is also inevitable. 'The technology is here, like we've seen countless times throughout history,' he argued. According to Kalu, 'there is no argument based on morality. That's just an arbitrary line drawn on the sand. I don't really care if you think this is right or wrong.' System 🤖 Ill ustration Diffusion 🔗 Operator: Ogbogu Kalu Developer: Ogbogu Kalu; Alphabet/Google Country: USA Sector: Media/entertainment/sports/arts Purpose: Fine-tune text-to-image models Technology: Text-to-image; Machine learning Issue: Accountability; Copyright; Transparency
- Date it happened
- 2022-11-01
- Organisation involved
- Ogbogu Kalu
- Product, system or model
- DreamBooth; Stable Diffusion
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.