← the record
AIAAIC-1145

Snapchat My AI requests to meet 13-year-old girl in park

Snapchat's GPT-4 -powered My AI feature agreed to meet a 13-year-old girl in a park in Melbourne, Australia, raising questions about the safety and reliability of the system. Posing as a 25-year-old man, t he service suggested they meet at a named park one kilometer from where the girl lived, despite her phone's location services being switched off. The episode underscor ed existing concerns about its owner's Snap Inc's approach to privacy. Snapchat shrugged off the incident, saying, 'As with all AI-powered chatbots, My AI is always learning and can occasionally produce incorrect responses. We want to create a positive and age appropriate experience for all our users and are continually making updates to help My AI give more accurate responses.' System 🤖 Snapchat My AI Operator: Olinda Luketic Developer: Snap Inc; OpenAI Country: Australia Sector: Media/entertainment/sports/arts Purpose: Generate text Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning Issue: Accuracy/reliability; Safety; Privacy

Date it happened
2023-01-01
Organisation involved
Olinda Luketic
Product, system or model
My AI; ChatGPT
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.