CivitAI accused of generating synthetic 'child pornography' images
M ultiple instances of non-consensual sexual imagery of specific people hav e been discovered on online AI model marketplace CivitAI. Despite the company's terms of service saying it w ould remove ' content depicting or intended to depict real individuals or minors (under 18) in a mature context, ' a 404 Media investigation uncovered a Billie Eilish model that generated nude images of a pregnant Eilish that was 'in place for weeks' before being removed. According to 404 Media , while CivitAI does enforce its policy and remove offending content, non-consensual sexual imagery is still posted to the site 'regularly', some of which stays on the platform 'for months'. T he Billie Eilish model, and the user who created the nude images, were allowed to remain on the site, alongside images of the singer clad in lingerie and with very large breasts, both of which are against CivitAI’s terms of service. Founded in January 2023 and headquartered in Boise, Idaho, CivitAI is a 'community platform' dedicated to fine-tuning open-source AI models such as Stable Diffusion in order to generate AI models and scenarios of more or less any kind.
- Date it happened
- 2023-01-01
- Product, system or model
- CivitAI
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.