Amazon Q hallucinates, leaks data
Amazon's Q generative AI service suffers from inaccuracy, privacy and security issues, according to company internal documents. Amazon employees expressed concerns about a variety of issues regarding Q, including that it has been 'experiencing severe hallucinations and leaking confidential data,' including the location of AWS data centers, internal discount programs, according to The Platformer , citing leaked Amazon documents. Amazon hit back by disputing claims that Q had released confidential data, and said it continued to fine-tune the system 'as it transitions from being a product in preview to being generally available.' I ndustry analysts questioned whether Q was ready for companies to use. Amazon has been seen criticised by some as being late to generative AI. Hallucination (artificial intelligence) In the field of artificial intelligence (AI), a hallucination or artificial hallucination (also called bullshitting, confabulation or delusion) is a response generated by AI that contains false or misleading information presented as fact . Source: Wikipedia 🔗 System 🤖 Amazon Q 🔗 Documents 📃 AWS announces Amazon Q (Preview) Operator: Casey Newton; Zoe Schiffler Developer: Ama zon Country: USA Sector: Business/professional services Purpose: Chatbot; NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning Technology: Generate text Issue: Accuracy/reliability; Confidentiality; Privacy
- Date it happened
- 2023-12-01
- Organisation involved
- Casey Newton; Zoe Schiffler
- Product, system or model
- Amazon Q
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.