← the record
AIAAIC-1238

Lensa AI undresses journalists without permission

Journalists were easily able to generate near-realistic adolescent and sexualised images of themselves using Lensa's Magic Avatars. J ournalists at Technology Review , TechCrunch, and Insider recorded how they were easily able to generate near-realistic adolescent and sexualised images of themselves. The findings prompted concerns about the effectiveness of the app's safety guardrails. Lensa’s terms of service oblige users to submit only appropriate content, including 'no nudes'. Lensa owner Prisma Labs CEO Andrey Usoltsev told TechCrunch that such behaviour 'can only happen if the AI is intentionally provoked' into creating unsafe content and blamed users for breaching its terms of use. System 🤖 Lensa AI Magic Avatars Operator: Melissa Heikkilä; Zoe Sottile Developer: Prisma Labs Country: UK; USA Sector: Media/entertainment/sports/arts Purpose: Generate avatars Technology: Neural network; Deep learning; Machine learning Issue: Stereotyping

Date it happened
2022-01-01
Organisation involved
Melissa Heikkilä; Zoe Sottile
Product, system or model
Magic Avatars 2.0
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.