← the record
AIAAIC-1078

AI meal planner app suggests chlorine gas recipe

A chatbot that generates meal suggestions and directions generated a recipe that recommended people concoct chlorine gas, which it called ‘aromatic water mix'. The incident called into the question the safety of the GPT-3.5 powered bot, despite its operator saying it had built in safeguards to stop these kinds of outputs. Kiwi political commentator Liam Hehir had asked Pak 'n Save's Savey meal-bot what he could make if only he had water, bleach and ammonia. A spokeperson for New Zealand-based supermarket chain Pak n'Save told The Guardian that the company was disappointed to see 'a small minority have tried to use the tool inappropriately and not for its intended purpose.' Pak’nSave promised to 'keep fine-tuning' its bot. System 🤖 Savey Meal-bot 🔗 Documents 📃 Pak n' Save (2023). Introducing the Savey Meal-bot Operator: Pak ‘n’ Save Developer: Pak ‘n’ Save; OpenAI Country: New Zealand Sector: Retail Purpose: Generate recipes Technology: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning Issue: Accuracy/reliability; Safety

Date it happened
2023-08-01
Organisation involved
Pak ‘n’ Save
Product, system or model
Savey Meal-bot; GPT-3.5
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.