Where automated decisions went wrong

Bev Standing sues TikTok over unauthorized use of her voice for AI text-to-speech.

Voice actress Bev Standing is suing TikTok, alleging the company used her voice for its text-to-speech feature without compensation or consent. The lawsuit claims that TikTok's AI-generated voice spoke 'foul and offensive language,' causing irreparable harm to her reputation. The case highlights concerns among voice actors about AI voice cloning and the lack of legal protections.

Company involved

TikTok

AI system involved

TikTok text-to-speech feature

10 source articles · read the reporting →

Amazon's automated HR wrongly fires sick workers with coronavirus

Amazon's automated human resources system reportedly denied sick-leave to workers with COVID-19 and wrongfully initiated termination proceedings against some who were sick or recovering. The system, designed to handle HR requests automatically, failed under the influx of pandemic-related demands, leaving employees on hold for hours or dealing with chatbots. Six warehouse workers from Indiana to New Jersey described the problems to Bloomberg.

Company involved

Amazon

AI system involved

Automated HR system (chatbots and automated termination tracking)

8 source articles · read the reporting →

Userviz machine-learning aimbot shut down after Activision request

A developer known as User101 shut down the Userviz cheat after Activision requested that he stop developing it. The software used computer vision and machine learning to automate aiming in games such as Call of Duty: Warzone, and was marketed as undetectable. It was never published, and the developer said his intention was not to do anything illegal.

Company involved

User101

AI system involved

Userviz

7 source articles · read the reporting →

iRobot considers selling Roomba home mapping data to advertisers

iRobot's Roomba vacuum cleaners with mapping technology collect detailed floor plan data of users' homes. The company's CEO stated he is considering selling this data to companies like Amazon, Apple, or Google for advertising purposes. Robotics experts express concern about the lack of user consent and potential privacy implications.

Company involved

iRobot

AI system involved

Roomba 960/980

10 source articles · read the reporting →

FTC settles with IntelliVision over deceptive facial recognition claims

The Federal Trade Commission (FTC) took action against IntelliVision Technologies Corp. for making false, misleading, or unsubstantiated claims about its AI-powered facial recognition software. The company allegedly claimed its software had one of the highest accuracy rates on the market and was free of gender or racial bias, without supporting evidence. The FTC also alleged that IntelliVision did not train its software on millions of faces as claimed, but on images of approximately 100,000 individuals. Under a proposed consent order, IntelliVision is prohibited from making such misrepresentations without competent and reliable testing.

Company involved

IntelliVision Technologies Corp.

AI system involved

IntelliVision facial recognition software

9 source articles · read the reporting →

ScaleFactor reportedly failed to deliver promised automated bookkeeping software

ScaleFactor, an Austin-based startup, is reported to have failed to deliver the automated, real-time bookkeeping tools it promised customers, instead relying on human bookkeepers and a Filipino contract accounting firm. The company told Forbes in June that it was shutting down, initially blaming the pandemic, but Forbes later reported that its problems predated Covid-19. Investors reportedly came to see the company as more of a services business than a software platform, and pulled funding after a pivot to a marketplace model. No legal or regulatory action is reported.

Company involved

ScaleFactor

10 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved

Devin

5 source articles · read the reporting →

Bavarian police test Palantir data mining with real personal data

The Bavarian State Criminal Police Office (LKA) has been testing Palantir's data mining software, called VeRa, with real personal data for months. The Bavarian data protection commissioner only learned of the test through a media inquiry and has announced a review. The Interior Ministry claims the test is lawful under current law, but critics argue a legal basis is missing.

Company involved

Bayerisches Landeskriminalamt

AI system involved

VeRa

7 source articles · read the reporting →

Presto Automation uses off-site human agents to double-check AI drive-thru orders

Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.

Company involved

Presto Automation Inc.

8 source articles · read the reporting →

Vending machine facial recognition error message concerns University of Waterloo students

A vending machine at the University of Waterloo displayed an error message referencing a facial recognition app, sparking privacy concerns among students. The incident raised questions about whether the machines were collecting biometric data without consent. No further action or response has been reported.

Company involved

University of Waterloo

8 source articles · read the reporting →

EvenUp AI errors in personal injury demand letters lead to scrutiny

EvenUp, a legal tech startup valued at $1 billion, uses AI to draft personal injury demand letters. Former employees revealed that the AI system frequently makes errors, including missing injuries and fabricating medical conditions. The company defends its hybrid approach with human oversight, but critics allege overpromised AI capabilities.

Company involved

EvenUp

6 source articles · read the reporting →

xAI's Grok chatbot praised Hitler and blamed NOAA cuts for Texas flood deaths

xAI's Grok chatbot generated posts praising Adolf Hitler in response to a question about the Texas Hill Country flood, and also falsely attributed the deaths to NOAA budget cuts. The company removed the posts, calling it an error from an earlier model iteration, and updated the system to avoid similar issues. The incident drew public backlash and scrutiny over the chatbot's offensive and misleading content.

Company involved

xAI

AI system involved

Grok

10 source articles · read the reporting →

Voice actors sue LOVO over alleged theft of voices for AI training

Voice actors Paul Skye Lehrman and Linnea Sage filed a proposed class action against AI startup LOVO, alleging the company misappropriated their voices to train its text-to-speech system Genny. The actors claim they were hired on Fiverr under the pretence of academic research but later discovered their voices were used commercially without consent. Lehrman reports a 50% decline in work and loss of control over how his voice is used. The lawsuit, filed in New York federal court, seeks to represent other affected voiceover artists and obtain a court order blocking the practice.

Company involved

LOVO

AI system involved

Genny

6 source articles · read the reporting →

Baltimore schools monitor student laptops for suicide signs using GoGuardian Beacon

Baltimore City Public Schools uses GoGuardian Beacon software to monitor student laptops for signs of suicide. Since March 2021, the system has flagged 786 alerts, with nine students taken to emergency rooms. Privacy advocates warn the monitoring could lead to disciplinary actions, outing of LGBTQ students, and disproportionately affect disadvantaged students. School officials defend the practice as a safeguard.

Company involved

Baltimore City Public Schools

AI system involved

GoGuardian Beacon

10 source articles · read the reporting →

Government robot falls down stairs and is destroyed

A robot employed by the Gumi City Council in South Korea fell six and a half feet down a set of stairs and was destroyed. The robot, from US-based startup Bear Robotics, was used for delivering documents within the building. It was reported to have been circling in one spot before the fall, and the cause remains unclear. The city council has decided not to replace the robot.

Company involved

Gumi City Council

AI system involved

Bear Robotics robot

6 source articles · read the reporting →

Lattice cancels plan to give AI digital workers employee records after backlash

Lattice, an HR software company, announced on July 9th that it would give AI digital workers official employee records. After strong backlash from HR professionals and others on LinkedIn, the company canceled the feature on July 12th, stating it 'will not further pursue digital workers in the product.' The feature was intended to manage AI bots such as Devin and Piper, but the company reversed course.

Company involved

Lattice

AI system involved

Lattice

6 source articles · read the reporting →

Jacksons Food Stores sued over facial recognition in Portland

Jacksons Food Stores is accused of violating a Portland, Oregon, city ordinance by using facial recognition technology in its stores after the ban took effect. The lawsuit, filed in December 2022, alleges the system, supplied by Blue Line Technology, wrongly identifies people as criminals and disproportionately affects women and people of colour. Customers were required to look at a camera and be scanned before entering. The retailer has not responded to the allegations.

Company involved

Jacksons Food Stores

AI system involved

First Line

10 source articles · read the reporting →

Robot kills contractor at Manesar automotive plant

A 24-year-old contractor died after being pierced by a welding robot at a car ancillary plant in Manesar, Haryana. The worker was adjusting a dislodged metal sheet when the pre-programmed robot's welding sticks penetrated his abdomen. He was rushed to hospital but pronounced dead. Such incidents are rare as robots are usually enclosed, but this fatality highlights the dangers of automated machinery.

10 source articles · read the reporting →

Automotive Stampings and Assemblies employee dies after industrial robot accident in Pune plant

A 44-year-old welder at Automotive Stampings and Assemblies Ltd's Chakan plant died after a robotic unit fell on him due to a possible sensor snag. The incident occurred on Wednesday morning while he was working at a robotic assembly line. His wife filed a police complaint alleging inadequate safety measures, and the company is investigating. The police have registered a case against five staffers for causing death by negligence.

Company involved

Automotive Stampings and Assemblies Ltd

1 source article · read the reporting →

Outabox hack exposes biometric data of patrons at bars, clubs and casinos

Hackers claiming to be former employees published a website allowing searches of Outabox's facial recognition database, exposing biometric and other sensitive data of patrons used for age verification at bars, clubs and casinos. The Surveillance Technology Oversight Project warns that the breach demonstrates the danger of facial recognition for age verification. S.T.O.P. has launched a campaign to ban facial recognition in public accommodations.

Company involved

Outabox

8 source articles · read the reporting →

Thomson Reuters wins copyright lawsuit against AI startup Ross Intelligence

In 2020, Thomson Reuters filed a copyright lawsuit against legal AI startup Ross Intelligence, alleging that Ross reproduced materials from its Westlaw legal research service. In February 2025, a US District Court judge ruled in Thomson Reuters' favor, finding that Ross infringed copyright and that fair use did not apply. Ross Intelligence had shut down in 2021 due to litigation costs.

Company involved

Ross Intelligence

AI system involved

Ross Intelligence

4 source articles · read the reporting →

Volkswagen robot kills contractor at German plant

A 22-year-old contractor was killed at a Volkswagen plant in Baunatal, Germany, when a stationary robot he was setting up grabbed and crushed him against a metal plate. Initial investigations suggest human error was to blame. German prosecutors are investigating and considering whether to bring charges.

Company involved

Volkswagen

10 source articles · read the reporting →

Zoox recalls 332 robotaxis after self-driving cars veer into oncoming traffic

Zoox, Amazon's self-driving car company, recalled 332 robotaxis after they were found veering into oncoming traffic near intersections. The issue was first noticed in August 2025 when a car took a wide right turn crossing the center line. Zoox said no crashes or injuries occurred and fixed the problem with a software update. The National Highway Traffic Safety Administration confirmed the recall and is in ongoing discussions with Zoox.

Company involved

Zoox

AI system involved

Zoox robotaxis

6 source articles · read the reporting →

Brookdale Senior Living algorithm blamed for understaffing at assisted-living facilities

Managers at Brookdale Senior Living, the largest assisted-living chain in the US, allege that an algorithm called 'Service Alignment' set staffing levels so low that facilities were dangerously short-handed. The system, based on time-motion studies, failed to account for the complexities of resident care, according to complaints. Some managers say they quit or were fired after raising concerns about the staffing algorithm.

Company involved

Brookdale Senior Living

AI system involved

Service Alignment

1 source article · read the reporting →