Scale AI shares sensitive Roomba robot vacuum training photos
Sensitive photographs used to train iRobot vacuum cleaners, including of a young woman sitting on the toilet, were shared on Facebook, triggering privacy advocates to question the effectiveness of iRobot data protection practices. According to Technology Review , images of development versions of iRobot’s Roomba J7 series robot vacuum were posted online b y Venezuelan contractors to San Francisco-bas ed Scale AI, a start-up that uses low-cost gig workers to annotate audio, photo, and video data used to train artificial intelligence systems. According to iRobot, the photos came from 'special development robots with hardware and software modifications that are not and never were present on iRobot consumer products for purchase.' The images, the company says, were ' shared in violation of a written non-disclosure agreement between iRobot and an image annotation service provider. ' iRobot declined to share the consent agreements with Technology Review , nor make any of its paid collectors or employees available to discuss their understanding of the terms. However, a follow-up article cited beta testers saying iRobot had 'failed spectacularly' to mention that personal images of their homes and children will be seen and analysed by other humans. iRobot CEO Colin Angle later confirmed the company terminated its relationship with Scale AI as a result of the incident. System 🤖 Roomba® j7 Robot Vacuum 🔗 Documents 📃 iRobot CEO (2022). Building Smart Robots Requires Responsible Development Operator: Amazon/iRobot; Scale AI Developer: Amazon/iRobot Country: USA; Venezu ela Sector: Consumer goods Purpose: Clean floor Technology: Robotics; Computer vision; IoT; Machine learning; Object recognition Issue: Privacy; Surveillance; Transparency
- Date it happened
- 2022-12-01
- Organisation involved
- Amazon/iRobot; Scale AI
- Product, system or model
- Roomba J7
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.