← the record
AIAAIC-1711

Pixel 9 Reimagine AI photo editing tool blasted for lack of safeguards

Google Pixel 9's Reimagine AI photo editing feature faced criticism for its lack of adequate safeguards. Reimagine allows users to dramatically alter photos using simple text prompts, going far beyond basic adjustments. The tool is seen to generate highly realistic edits, matching lighting, shadows, and perspective with the original photo, making alterations difficult to detect. However, c ritics expressed concerns that th e feature could be exploited to create and spread false or manipulated images, especially during real-time events , and that it makes sophisticated image manipulation accessible to anyone, lowering barriers to creating misleading content. In addition, Google was singled out for not placing obvious watermarks on AI-generated images, making it challenging for viewers to identify manipulated content. Tests show the ability to easily add concerning elements to photos, such as car wrecks, explosions, or drug paraphernalia. Google responded by emphasising that the tool is designed for creativity and personal use, but acknowledged the need for ongoing refinement of safeguards. System 🤖 Reimagine 🔗 Documents 📃 Google. Safety & regulatory guide for Pixel 9, Pixel 9 Pro & Pixel 9 Pro XL Operator: Pixel 9 users Developer: Alphabet/Google Country: Global Sector: Media/entertainment/sports/arts Purpose: Edit photographs Technology: Computer vision; Text-to-image; Machine learning Issue: Copyright; Dual/multi-use; Mis/disinformation

Date it happened
2024-08-01
Organisation involved
Google
Product, system or model
Reimagine
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.