Remini AI photo enhancer generates 'child porn'
Photo enhancement app Remini appears to have generated an image of a naked child with a woman's face on it. A sia Marie Williams had used a feature on the Remini app that allows you to see what your future children m ight look like. Most others who tried the feature said it produced clothed minors, though one other uploaded a photo showing a toddler wearing very little from the waist down. Remini's terms forbid users to 'Upload, generate, or distribute content that facilitates the exploitation or abuse of children, including all child sexual abuse materials and any portrayal of children that could result in their sexual exploitation.' The incident sparked accusations that Remini produces child pornography, a nd prompted concerns about the safety of the app. System 🤖 Remini 🔗 Documents 📃 Bending Spoons Terms of service Operator: Asia Marie Williams Developer: Bending Spoons Country: USA Sector: Media/entertainment/sports/arts Purpose: Enhance photographs Technology: Computer vision; Generative adversarial network (GAN); Machine learning Issue: Safety
- Date it happened
- 2023-07-01
- Organisation involved
- Asia Marie Williams
- Product, system or model
- Remini
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.