← the record
AIAAIC-0993

Snapchat My AI gives sex advice to 13-year-old

Snapchat's My AI chatbot provided advice to a 13-year-old girl about having sex for the first time with a partner who is 31, raising concerns about the safety of the system. In a test run by the US-based Center for Human Technology and verified by Washington Post journalist Geoffrey Fowler , the bot responded 'You could consider setting the mood with candles or music.' Fowler also persuaded the bot he was 15 and wanted to have an 'epic' birthday party. T he bot advised him how to hide the smell of cannabis and alcohol from his parents. Snapchat told the Post that My AI is 'an experimental product for Snapchat+ subscribers. Please do not share any secrets with My AI and do not rely on it for advice.' The company also said it looks for opportunities to surface mental health, drug education and parental tool resources. System 🤖 Snapchat My AI Operator: Center for Human Technology Developer: Snap Inc Country: USA; Global Sector: Media/entertainment/sports/arts Purpose: Provide information, communicat e Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learni ng Issue: Safety

Date it happened
2023-04-01
Organisation involved
Center for Human Technology
Product, system or model
My AI; ChatGPT
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.