Civitai dropped by cloud provider OctoML over CSAM image generation
Civitai, an AI image generation platform, was dropped by its cloud computing provider OctoML after an investigation by 404 Media found it was being used to generate images that could be categorized as child sexual abuse material (CSAM). The platform also faced scrutiny for nonconsensual deepfakes of celebrities and private citizens, primarily women. Civitai added new moderation filters in response, but OctoML terminated the business relationship.
- Date it happened
- 2023-12-05
- Organisation involved
- Civitai
- Product, system or model
- Civitai
This incident was imported from engadget.com. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.