← the record
AIAAIC-1306

AI-generated product listings flood Amazon

Amazon has been listing AI-generated names and descriptions of products for sale on its website. Garden chairs, hoses, and other products with product names and descriptions named after ChatGPT error messages have been listed for sale on Amazon.com. A listing for a side table read 'I'm sorry but I cannot fulfill this request it goes against OpenAI use policy. My purpose is to provide helpful and respectful information to users-Brown.' The discovery suggested companies are using ChatGPT to develop product names and descriptions without checking or editing before they are listed, resulting in the perceived deterioration of Amazon's platform. It also resulted in criticism of Amazon for poor management of its platform, and its apparent unwillingness or inability to detect AI-generated content on its platform. System 🤖 Amazon content moderation system Operator: Amazon Developer: Amazon Country: USA Sector: Retail Purpose: Moderate content Technology: Content moderation system; Machine learning Issue: Accuracy/reliabi lity N ews, commentary, analysis 🗞️ https://www.theverge.com/2024/1/12/24036156/openai-policy-amazon-ai-listings https://www.digitalinformationworld.com/2024/01/new-product-listings-on-amazon-causes.html https://interestingengineering.com/culture/amazons-ai-generated-products-listings-are-hilariously-bad https://futurism.com/amazon-products-ai-generated https://arstechnica.com/ai/2024/01/lazy-use-of-ai-leads-to-amazon-products-called-i-cannot-fulfill-that-request/

Date it happened
2024-01-01
Organisation involved
Amazon
Product, system or model
Amazon content moderation system
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.