Amazon kept children's Alexa recordings indefinitely, violating COPPA
The FTC and DOJ allege Amazon violated the Children’s Online Privacy Protection Act Rule by retaining children's Alexa voice recordings and geolocation data indefinitely, even after parents requested deletion. Amazon is accused of misleading parents about its data deletion practices and using the unlawfully retained data to train its Alexa algorithm. A proposed federal court order requires Amazon to pay a $25 million civil penalty, delete inactive child accounts and certain data, and implement stringent privacy safeguards.
- Company involved
- Amazon
- AI system involved
- Alexa
4 source articles · read the reporting →
Amazon locks user's account for a week after driver misinterprets doorbell's automated response
On May 25, 2023, Amazon locked Brandon Jackson's account and logged out all his Echo devices after a delivery driver reported receiving racist remarks from his doorbell. The doorbell, a Eufy device, had issued an automated response 'Excuse me, can I help you?' which the driver misinterpreted. Jackson submitted video evidence showing no such remarks were made, but his account remained locked until May 31. He alleges that Amazon's automated system overreacted and that the company failed to properly investigate.
- Company involved
- Amazon
- AI system involved
- Amazon Echo devices, Alexa, Eufy doorbell
9 source articles · read the reporting →
Amazon drone delivery aborts first commercial flight in Lockeford, California
On December 22, 2022, Amazon's Prime Air attempted its first commercial drone delivery to a customer in Lockeford, California. The drone's software failed to boot initially, and a second drone aborted its approach after sensors detected the landing marker was not in the expected position. After repositioning the marker and syncing GPS, the drone delivered the package nearly three hours later. Amazon denied that any incident occurred during customer deliveries.
- Company involved
- Amazon
- AI system involved
- MK27-2
10 source articles · read the reporting →
Amazon planned to keep data centre water use secret
Amazon strategised to keep the water consumption of its data centres secret, a leaked internal document reveals. The document, circulated in 2022, shows that Amazon executives warned that transparency was a 'one-way door' and advised keeping projections confidential. Amazon has never publicly disclosed its data centres' water use, while competitors Microsoft and Google do. Amazon denied the document's accuracy, calling it obsolete.
- Company involved
- Amazon
10 source articles · read the reporting →
Network Rail denies using AI cameras to detect passengers' emotions
Network Rail conducted a trial of AI cameras at major stations in 2022 that analysed demographic details and reportedly assessed emotions. Documents obtained by Big Brother Watch indicate the system was capable of determining whether a passenger was happy, sad or angry, with potential use for measuring satisfaction and advertising. Network Rail denied that any emotion analysis took place and stated the image analysis for demographic details has ended. Big Brother Watch has submitted a complaint to the Information Commissioner about the trial.
- Company involved
- Network Rail
- AI system involved
- Amazon Rekognition
7 source articles · read the reporting →
Amazon Alexa gives shocking challenge to 10-year-old
A parent reported that their 10-year-old child asked an Amazon Echo device with Alexa for a challenge, and Alexa responded with something the parent found shocking. The incident was shared on Twitter on 26 December 2021. No further details about the response or any harm were provided.
- Company involved
- Amazon
- AI system involved
- Alexa
3 source articles · read the reporting →
Amazon's search algorithm favors its own brands over competitors
The Markup investigated Amazon's product search results and found that the company's algorithm prioritizes its own house brands and exclusive products over competitors, even when competitors have higher ratings and more reviews. A national survey commissioned by The Markup found that 90% of respondents were unaware that Amazon's highest-selling house brands were owned by the company. Amazon denied favoring its own brands in search results.
- Company involved
- Amazon
- AI system involved
- Amazon product search ranking algorithm
10 source articles · read the reporting →
Amazon Rekognition faces scrutiny in false arrest lawsuit
The system identified Christopher Gatlin as a suspect, leading to his arrest and 17-month incarceration.
- Company involved
- St. Louis County Police Department
- AI system involved
- Amazon Rekognition
1 source article · read the reporting →
Amazon Prime Air drone crashes investigated by FAA, documents show
Amazon's Prime Air drone delivery programme is accused of obstructing federal investigations into crashes of its autonomous drones, according to FAA documents. The company is said to have moved wreckage and delayed sharing information, including after a drone crashed and started a 20-acre brush fire in Oregon. Amazon denies the claims, saying it has complied with all regulatory requirements.
- Company involved
- Amazon
- AI system involved
- Prime Air
10 source articles · read the reporting →
Amazon sued after monitoring software allegedly caused delivery van crash
In March 2021, an Amazon delivery van rear-ended a Tesla on Interstate 75 near Atlanta, causing a multi-vehicle crash that left a passenger with a traumatic brain injury and paralysis. The victim alleges that Amazon's Flex app and in-van AI cameras, which monitor drivers for speed and yawning, pressured the driver to speed, leading to the collision. Amazon denies liability, arguing the driver was employed by a contractor, but the lawsuit claims the company's software micromanages drivers and prioritizes speed over safety. The case, which seeks damages exceeding $2 million in medical bills, is pending.
- Company involved
- Amazon
- AI system involved
- Amazon Flex app
1 source article · read the reporting →
Senators question Amazon over AI cameras monitoring delivery drivers
Five US senators wrote to Amazon CEO Jeff Bezos demanding answers about the company's deployment of AI-equipped cameras in delivery vans. The Netradyne Driveri cameras record drivers continuously and flag safety infractions, raising concerns about privacy and potential pressure on drivers to speed. The senators asked how Amazon will protect against new safety hazards from increased surveillance. Amazon had not responded at the time of reporting.
- Company involved
- Amazon
- AI system involved
- Netradyne Driveri
4 source articles · read the reporting →
Amazon Mentor app falsely flags drivers, leading to firings and lost pay
Amazon requires contracted delivery drivers to use the Mentor app, which tracks and scores driving behavior. Drivers report that the app falsely detects infractions, such as incoming calls or picking up a device, causing their scores to drop. This leads to disciplinary actions including firing, loss of bonuses, and reduced pay. Amazon has not addressed the specific allegations.
- Company involved
- Amazon
- AI system involved
- Mentor
10 source articles · read the reporting →
Google, Amazon, Microsoft image AI shows gender bias, labelling women by appearance and men by profession
A study by US and European researchers found that Google, Amazon, and Microsoft's image recognition services applied three times as many appearance-related labels to photos of women as to men. The top labels for men were 'official' and 'businessperson', while for women they were 'smile' and 'chin'. Google acknowledged the issue and had previously switched off gender detection, but tests by WIRED suggested the bias persisted. The researchers warn that such biased AI could obscure women professionals and create a false image of reality.
- Company involved
- Google, Amazon, Microsoft
- AI system involved
- Google Cloud Vision, Amazon Rekognition, Microsoft image recognition service
1 source article · read the reporting →
Amazon's automated HR wrongly fires sick workers with coronavirus
Amazon's automated human resources system reportedly denied sick-leave to workers with COVID-19 and wrongfully initiated termination proceedings against some who were sick or recovering. The system, designed to handle HR requests automatically, failed under the influx of pandemic-related demands, leaving employees on hold for hours or dealing with chatbots. Six warehouse workers from Indiana to New Jersey described the problems to Bloomberg.
- Company involved
- Amazon
- AI system involved
- Automated HR system (chatbots and automated termination tracking)
8 source articles · read the reporting →
Amazon threatens to fire workers for breaking social distancing rules using AI monitoring
Amazon announced a policy to fire warehouse workers who repeatedly violate social distancing rules aimed at preventing the spread of COVID-19. The company plans to use internal cameras and machine learning to detect violations. Workers have criticized the policy and staged strikes, calling for better protections.
- Company involved
- Amazon
10 source articles · read the reporting →
UCLA abandons facial recognition plans after test reveals racial bias
UCLA had proposed using facial recognition surveillance on campus, scanning faces and checking them against a mugshot database. Fight for the Future tested Amazon Rekognition on photos of UCLA sports teams and faculty, finding that the software falsely matched 58 individuals, mostly people of color, with mugshot photos. Following community backlash and the test results, UCLA's administration announced it was abandoning the plan.
- Company involved
- UCLA
- AI system involved
- Rekognition
10 source articles · read the reporting →
Amazon tracked every minute of JFK8 warehouse workers' shifts, documents show
Internal documents show Amazon's Time Off Task tool tracked every minute of JFK8 warehouse workers' shifts using handheld scanners and identified a 'top offender' per shift. Managers questioned those workers about each period of inactivity, including bathroom breaks, and issued warnings or fired them for 30 to 120 minutes of time off task. The article reports that 18 workers were terminated between January and February 2020, and workers said they skipped water and bathroom breaks for fear of discipline. Amazon did not respond to a request for comment.
- Company involved
- Amazon
- AI system involved
- Time Off Task Tool
3 source articles · read the reporting →
Amazon hid rising injury rates at robotic warehouses
Internal records obtained by Reveal show Amazon misled the public about worker safety, with serious injury rates at its fulfilment centres rising 33% from 2016 to 2019. Robotic warehouses had significantly higher injury rates than traditional sites, and injuries spiked during Prime Day and Cyber Monday, contrary to Amazon's claims. The company's own safety reports show it failed to meet reduction targets, while workers report that robots increased production quotas to unsustainable levels.
- Company involved
- Amazon
- AI system involved
- Amazon robotic fulfilment system
2 source articles · read the reporting →
Amazon's algorithm recommended suicide aids alongside a lethal preservative
Amazon sold a food preservative that people were using to die by suicide. The company's algorithm began suggesting other products that customers frequently bought along with it to aid in such efforts. Despite pleas from grieving families and explicit warnings in product reviews, Amazon declined to act. Members of Congress have now demanded answers from Amazon's CEO.
- Company involved
- Amazon
2 source articles · read the reporting →
Advocates demand FTC investigation of Amazon Echo Dot Kids for COPPA violations
A coalition of consumer and public health advocates, led by the Campaign for a Commercial-Free Childhood and the Center for Digital Democracy, filed a complaint with the FTC alleging that Amazon's Echo Dot Kids Edition violates the Children's Online Privacy Protection Act. The complaint claims that Amazon collects and retains children's voice recordings and other personal data indefinitely, even after parents request deletion. The advocates also allege that Amazon's privacy policies are confusing and that it fails to verify parental consent. The FTC has not yet responded publicly.
- Company involved
- Amazon
- AI system involved
- Echo Dot Kids Edition
10 source articles · read the reporting →
Amazon robot punctures bear spray can, hospitalising 24 workers
An automated machine at an Amazon warehouse in Robbinsville, New Jersey, punctured a can of bear repellant on 5 December 2018, releasing capsaicin fumes. Twenty-four employees were taken to hospital as a precaution, with all expected to be released within 24 hours. Amazon stated that a full investigation is underway and that employee safety is a top priority. The incident has renewed criticism of working conditions at Amazon's warehouses.
- Company involved
- Amazon
10 source articles · read the reporting →
Study finds Amazon Rekognition has higher error rates for darker-skinned women
A study by Raji and Buolamwini found that Amazon's Rekognition facial analysis tool had a 31% error rate for classifying the gender of darker-skinned women, compared to 0% for lighter-skinned men. Amazon officials Matthew Wood and Michael Punke wrote blog posts disputing the findings, calling them misleading. The researchers called on Amazon to stop selling Rekognition to law enforcement.
- Company involved
- Amazon
- AI system involved
- Amazon Rekognition
10 source articles · read the reporting →
Amazon Rekognition Falsely Matches 28 Members of Congress with Mugshots
The ACLU conducted a test of Amazon's Rekognition facial recognition system, comparing photos of members of Congress against a database of 25,000 mugshots. The system incorrectly matched 28 legislators, disproportionately people of colour, including six members of the Congressional Black Caucus. The test highlights the risk of false matches and biased inaccuracies in law enforcement use of face surveillance. The ACLU calls for a moratorium on police use of the technology.
- Company involved
- American Civil Liberties Union
- AI system involved
- Rekognition
1 source article · read the reporting →
Amazon Alexa recorded private conversation and sent it to random contact
A Portland family discovered that their Amazon Alexa device had recorded a private conversation in their home and sent the audio to a random contact in Seattle. The device misinterpreted background noise as a series of commands to send a message. Amazon investigated and acknowledged the rare occurrence, apologising and stating they are taking steps to prevent it in future. The user unplugged her devices and sought a refund, which Amazon has not provided.
- Company involved
- Amazon
- AI system involved
- Amazon Alexa
1 source article · read the reporting →
