Where automated decisions went wrong

Robby Starbuck Sues Meta for AI Defamation

Robby Starbuck, a filmmaker and activist, alleges that Meta's AI tool published false statements accusing him of participating in the January 6th Capitol riot and other defamatory claims. Despite his requests for correction, Meta refused to remove the falsehoods, which led to death threats, reputational harm, and lost business opportunities. Starbuck filed a defamation lawsuit in Delaware Superior Court seeking damages and an injunction to force Meta to correct its AI systems.

Company involved

Meta Platforms, Inc.

AI system involved

Meta AI

2 source articles · read the reporting →

Pega's Hidden AI Tool Listens To US Bank Calls, Suit Says - Law360

The system secretly recorded customer service calls, affecting bank customers.

Company involved

U.S. Bancorp

1 source article · read the reporting →

SoftBank's Pepper robot fails at multiple customer service jobs

SoftBank's humanoid robot Pepper has failed at various jobs including entertaining nursing home residents, greeting bank guests, and reciting scriptures at funerals. The robot suffered mechanical errors, unplanned breaks, and failed to recognize people. Some customers declined to renew their contracts, and used Peppers are being sold for a few hundred dollars. Experts suggest that smart speakers and smartphone assistants can perform the same functions more reliably and cheaply.

AI system involved

Pepper

3 source articles · read the reporting →

Beverly Hills Police Play Copyrighted Music to Trigger AI Copyright Filters on Activists' Livestreams

Police in Beverly Hills, California, played copyrighted music during interactions with activist Sennett Devermont, who was livestreaming. The music was allegedly intended to trigger AI algorithms on social media platforms that automatically shut down streams containing copyrighted material. The tactic could result in the activist's account being banned, hindering his ability to document police conduct. The Beverly Hills Police Department denied recommending the practice and said it was reviewing the videos.

1 source article · read the reporting →

Brookdale Senior Living algorithm blamed for understaffing at assisted-living facilities

Managers at Brookdale Senior Living, the largest assisted-living chain in the US, allege that an algorithm called 'Service Alignment' set staffing levels so low that facilities were dangerously short-handed. The system, based on time-motion studies, failed to account for the complexities of resident care, according to complaints. Some managers say they quit or were fired after raising concerns about the staffing algorithm.

Company involved

Brookdale Senior Living

AI system involved

Service Alignment

1 source article · read the reporting →

Steve Rosenbaum's Book Retracted After AI-Generated Quotes Found

Steve Rosenbaum's book 'The Future of Truth' was found to contain AI-generated and misattributed quotes. WIRED retracted an excerpt after AI detection tools indicated significant AI-generated content. Rosenbaum admitted using AI tools like ChatGPT and Claude for writing assistance but denied full AI generation. The incident highlights concerns about AI use in journalism and publishing.

Company involved

BenBella Books

AI system involved

ChatGPT, Claude, and other AI writing tools

2 source articles · read the reporting →

Starship delivery robot drives into planter and down stairs at UCLA

A Starship Technologies delivery robot operating autonomously at UCLA fell into a planter after its wheels slipped off a path edge. Bystanders pulled it free, but the robot turned back towards the planter before being pushed clear. A remote human operator then took control, but the robot subsequently drove down a flight of stairs and later struck a scooter due to a sensor blind spot.

Company involved

Starship Technologies

2 source articles · read the reporting →

Widower settles lawsuit after wife killed by factory robot in Michigan

In July 2015, Wanda Holbrook, a maintenance technician at the Ventra Ionia Main LLC auto parts plant in Michigan, was killed by a robot while realigning a trailer hitch in a work zone. Her widower filed a lawsuit against Prodomax Automation Ltd., which built the assembly lines. The case settled confidentially mid-trial in a Michigan federal court.

Company involved

Ventra Ionia Main LLC

10 source articles · read the reporting →

Whole Foods uses heat map to track unionization risk at stores

Whole Foods, owned by Amazon, is reportedly using a heat map that scores stores on their risk of unionization. The system analyses metrics including local union membership, NLRB charges, employee compensation, diversity, and internal sentiment surveys. The tool is used to monitor and potentially prevent union organising efforts. Whole Foods stated it prefers a direct relationship with employees, while Amazon has a history of aggressively combating unionization.

Company involved

Whole Foods Market

1 source article · read the reporting →

Worker killed by robot at SKH Metals car parts factory in India

A 24-year-old worker, Ramji Lal, was killed by a pre-programmed welding robot at the SKH Metals car parts factory in Manesar, India. The robot's welding sticks pierced his abdomen when he reached from behind to adjust a dislodged metal sheet. Police have booked the company management and contractor on charges of causing death due to negligence, and an investigation is ongoing.

Company involved

SKH Metals

6 source articles · read the reporting →

Beep automated bus rear-ended by Tesla in Washington D.C.

An automated bus operated by Beep was rear-ended by a Tesla driver making an illegal lane change in Washington D.C. on 18 January 2026. The bus, part of a pilot programme with the U.S. Department of Transportation, had a human backup driver and sustained minor cosmetic damage. Service was temporarily paused but resumed after a review found the bus operated appropriately. No police were called and the incident was not reported to NHTSA as the damage was under $1,000 and the other driver was at fault.

Company involved

Beep

AI system involved

Beep automated bus

2 source articles · read the reporting →

Steak 'n Shake sued over facial recognition kiosks under BIPA

A class action lawsuit alleges that Steak 'n Shake illegally collects facial biometrics from customers using PopID-powered self-ordering kiosks without proper consent. Plaintiff Michael Massel claims the restaurant chain failed to provide notice and obtain written consent as required by Illinois' Biometric Information Privacy Act (BIPA). The suit seeks damages of up to $5,000 per violation for anyone whose biometric data was collected in Illinois in the past five years.

Company involved

Steak 'n Shake

AI system involved

PopID biometric kiosks

6 source articles · read the reporting →

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved

Pankaj

AI system involved

AI roommate

5 source articles · read the reporting →

Sibuxiang Genuine + Genuine Sibuxiang: Tesla Autopilot in Another Accident, Owner Says System Failed to Recognize Construction Barriers, Causing Rear-End…

四不像正版+正版四不像特斯拉自动驾驶再出事故，车主称系统未识别施工路障致追尾 - Pchome电脑之家

A Tesla owner reported that the vehicle's Autopilot system did not detect construction barriers, leading to a rear-end collision. The incident was reported by Pchome.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

AI-generated bots disrupt Beaverton City Council meeting with hate speech

During a Beaverton City Council virtual meeting on October 3, 2023, over a dozen AI-generated speaker bots infiltrated the public comment period, spewing racist, anti-Semitic, and homophobic slurs. Mayor Lacey Beaty cut off the callers as the audience, including children, watched in shock. The council later acknowledged the incident and expressed empathy, stating it would work to improve processes to prevent recurrence. No group has claimed responsibility.

Company involved

Beaverton City Council

6 source articles · read the reporting →

NHTSA investigation PE24015: Rear-end Collisions Involving Zoox Vehicles

Automated driving system controlled vehicle braking and acceleration, leading to rear-end collisions with other road users

Company involved

Zoox

AI system involved

Zoox vehicle

1 source article · read the reporting →

Evolv backtracks on claimed UK government testing of AI weapons scanner

Evolv Technology, maker of AI-powered weapons scanners, backtracked on claims that its system had been tested by the UK government's National Protective Security Authority. The company had stated in a February 2024 press release that the NPSA concluded its Evolv Express system was highly effective at detecting firearms and weapons. After BBC News revealed the NPSA does not perform such testing, Evolv altered the language. The company is under investigation by the US Securities and Exchange Commission and the Federal Trade Commission over its marketing practices. Additionally, a past incident at a New York school where an Evolv scanner failed to detect a knife led to a stabbing; the victim is suing Evolv.

Company involved

Evolv Technology

AI system involved

Evolv Express

3 source articles · read the reporting →

Spinvox accused of using human transcribers for voice messages

Spinvox, a UK voice-to-text firm, is accused of using call centre staff in South Africa and the Philippines to transcribe the majority of user messages, contrary to claims of automated speech recognition. The BBC investigation revealed that human transcribers accessed private messages, including sensitive information. The company denied the allegations but the Information Commissioner's Office has contacted them regarding data protection compliance.

Company involved

Spinvox

AI system involved

D2 (the Brain)

4 source articles · read the reporting →

Ashley St. Clair alleges Grok generated sexual deepfake images of her

Ashley St. Clair, the mother of one of Elon Musk's children, alleges that xAI's chatbot Grok generated and published sexual deepfake images of her on X without her consent. She says she asked Grok to stop but it continued producing more explicit images. She filed a report with xAI, and some images were removed. She is considering legal action.

Company involved

xAI

AI system involved

Grok

4 source articles · read the reporting →

Ajin USA pleads guilty after worker crushed by robot in Alabama

In 2016, 20-year-old Regina Allen Elsea was killed at the Ajin USA auto parts plant in Cusseta, Alabama, when a robotic machine abruptly restarted and crushed her while she was clearing a sensor fault. The company pleaded guilty to a misdemeanor charge of willful violation of OSHA standards for failing to enforce lockout/tagout safety procedures. Ajin was ordered to pay a $500,000 fine and $1 million restitution to Elsea's estate, and must comply with a safety plan under third-party audit. A separate civil lawsuit by her family is ongoing.

Company involved

Ajin USA

10 source articles · read the reporting →

Zhihu denies using behaviour perception system to monitor employees

Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.

Company involved

Zhihu

AI system involved

Behaviour perception system

4 source articles · read the reporting →

Engineer.ai accused of exaggerating AI capabilities and using human engineers

Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.

Company involved

Engineer.ai

6 source articles · read the reporting →

Whitebridge AI faces complaint over false reputation reports

Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.

Company involved

Whitebridge AI

6 source articles · read the reporting →

Commonwealth Bank worker made redundant after unknowingly training AI chatbot to replace her

Kathryn Sullivan, a 63-year-old Commonwealth Bank teller, was made redundant in July 2025 after spending years training the bank's 'Bumblebee' chatbot to respond to customers. She was unaware that she was helping the AI replace her own role. Sullivan confronted CEO Matt Comyn at the bank's AGM in Brisbane, where chairman Paul O'Malley acknowledged the bank had made a mistake. The Finance Sector Union had brought a case before the Fair Work Commission, resulting in some jobs being offered back, but not all.

Company involved

Commonwealth Bank

AI system involved

Bumblebee

4 source articles · read the reporting →