Amazon AI product summaries exaggerate negative reviews
Product summaries generated by an Amazon AI system are inaccurately describing products and in some instances exaggerating negative feedback. For example, the home fitness company Teeter sells an inversion table designed to ease back pain. Amazon's AI generated summary calls it a desk: 'Customers like the sturdiness, adjustability and pain relief of the desk.' And whilst the Brass Birmingham board game has a 4.7-star rating based on feedback from over 500 shoppers, the three-sentence AI review summary ends: 'However, some customer have mixed opinions on ease of use.' Under 1 percent of reviews mention ease of use in a way that could be interpreted as critical. Amazon introduced AI product reviews for its US platform in August 2023. The finding has implications for customers, and for merchants selling products on Amazon's platform, according to Bloomberg. System 🤖 Amazon customer reviews Documents 📃 Amazon (2023). How Amazon continues to improve the customer reviews experience with generative AI Operator: Amazon Developer: Amazon Country: USA Sector: Retail Purpose: Summarise product reviews Technology: NLP/text analysis; Neural network; Deep learning; Machine learning; Reinforcement learning Issue: Accuracy /reliability
- Date it happened
- 2023-12-01
- Organisation involved
- Amazon
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.