← the record
AIAAIC-1241

Lensa AI generates nudes from childhood photos

Childhood photographs of academic Olivia Snow uploaded to Lensa AI's Magic Avatars system generated fully nude images, raising questions about the product's governance. Despite only uploading headshots of herself, Snow, a research fellow at UCLA’s Center for Critical Internet Inquiry, described in WIRED how Magic Avatars generated nudes from her childhood photos. According to Snow, 'many users—primarily women—have noticed that even when they upload modest photos, the app not only generates nudes but also ascribes cartoonishly sexualized features, like sultry poses and gigantic breasts, to their images.' The incident prompted commentators to express concerns about the ineffectiveness of Lensa 's no nudes policy . Lensa blamed its users, saying that any pornographic images generated by Magic Avatars are 'the result of intentional misconduct on the app'. System 🤖 Lensa AI Magic Avatars Operator: Olivia Snow Developer: Prisma Labs Country: USA Sector: Media/entertainment/sports/arts Purpose: Create avatars Technology: Neural network; Deep learning; Machine learning Issue: Privacy

Date it happened
2022-12-01
Organisation involved
Olivia Snow
Product, system or model
Magic Avatars 2.0
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.