Where automated decisions went wrong

"This is so sad": AI nurse scam costs Australian pensioner R2m - briefly.co.za

The AI-generated deepfake video persona convinced the pensioner to send money.

1 source article · read the reporting →

Secondary Collision on Freeway 1 in Sanyi, Miaoli Kills 3, Injures 3; Female Driver Claims Using ACC Then Denies It

國1苗栗三義「二次追撞」釀3死3傷肇事女駕駛稱開ACC又否認- 社會 - 自由時報

On the Sanyi section of National Highway 1 in Miaoli, a secondary rear-end collision involving three vehicles resulted in three fatalities and three injuries. The SUV's female driver initially stated she was using adaptive cruise control before later denying it during formal questioning. Authorities are still investigating the exact cause of the crash.

AI system involved

ACC (adaptive cruise control)

1 source article · read the reporting →

Data confirms Autopilot/FSD was active in crash that killed a mother, passerby saved her baby - Electrek

The car's driver-assist system steered the vehicle off the road, causing a crash that killed the driver.

Company involved

Tesla

AI system involved

Autopilot/Full Self-Driving

1 source article · read the reporting →

Haldwani Man Arrested for Posing as Para SF Major With AI-Generated Army Photos - Shop SSBCrack

The system generated fake images that made the accused appear as an Indian Army Para SF Major, deceiving people online.

Company involved

Indian Army

1 source article · read the reporting →

Florida 'deputy of the year' resigns after claims he tracked ex with Flock cameras, used N-word, did Nazi salute -…

The Flock camera system tracked the location of the deputy's ex-girlfriend's vehicle without her knowledge.

Company involved

Flock

AI system involved

Flock

1 source article · read the reporting →

Police Officer Accused of Using Flock Cameras To Secretly Track Women - Newsweek

The system tracked the license plates and movements of seven women and four men without their knowledge or consent.

Company involved

Flock Safety

AI system involved

Flock Safety

1 source article · read the reporting →

Tesla-förare dog i krasch – förarassistansen var aktiverad - Nyheter24

A Tesla driver-assistance system was active when the car left the road, crashed, and caught fire, killing the driver.

Company involved

Tesla

1 source article · read the reporting →

Highway Driver Dozes Off While Using Smart Driving, Car Flips Over; Driver: 'I Was Drowsy, It Crashed'

司机高速上开智驾打盹车撞翻了 司机：“我开了智驾，有点瞌睡，它就撞了” - 新浪网

A driver on a Jiangxi expressway activated the smart driving feature and then dozed off, causing the car to hit a crash barrier and roll over. The driver, who was wearing a seatbelt, was not injured. Traffic police determined the crash happened because the driver mistook the assisted driving system for full self-driving and failed to remain attentive.

1 source article · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

Texas police sergeant accused of using Flock cameras to stalk female coworker; he surrendered his law-enf - The Times of…

The Flock camera system was used to track and monitor a female officer's vehicle movements without her knowledge.

Company involved

Pasadena Police Department

AI system involved

Flock Safety

1 source article · read the reporting →

A Georgia Cop Used Flock to Track 2 Other Cops: His Ex and Her Friend - WIRED

The system tracked the vehicle locations of a former romantic partner and a fellow police officer.

Company involved

Alpharetta Police Department

AI system involved

Flock Safety

1 source article · read the reporting →

Shively police officer accused of using Flock system to track, harass woman for months - WLKY

A police officer tracked a woman's movements across Kentucky and Indiana using the Flock camera system.

Company involved

Shively Police Department

AI system involved

Flock

1 source article · read the reporting →

Shanahan Had Autopilot Engaged During Crash

沙納漢車禍時啟動自動輔助駕駛 - singtaousa.com

San Francisco 49ers head coach Kyle Shanahan revealed that his Tesla's Autopilot was activated during a July 14 crash in Palo Alto. He admitted fault, saying he was distracted when his phone slipped and he may have accidentally disengaged the system. Shanahan sustained serious injuries, while the other driver had minor injuries.

Company involved

Tesla

AI system involved

Autopilot

1 source article · read the reporting →

Court docs: IMPD officer tracked women through Flock, arranged run-ins - IndyStar

An IMPD officer used Flock cameras to track the license plates of a dozen women and arranged run-ins with them.

Company involved

Flock Safety

AI system involved

Flock

1 source article · read the reporting →

Federal Lawsuit in Melbourne Airport Police Shooting Names Flock; Records Contradict the Official Account - The Space Coast Rocket

The Flock system generated a 30-day chronological reconstruction of John Jay Niebuhr's vehicle movements from thousands of license plate camera captures.

Company involved

Flock Group, Inc.

AI system involved

Flock Falcon

1 source article · read the reporting →

A Motorcyclist Died And Two Others Were Killed. A False Flock ID Helped Police Arrest The Wrong Person - RideApart.com

The Flock ALPR system incorrectly identified Lindsay Isaacs's vehicle as involved in a fatal crash, leading to her wrongful arrest and imprisonment.

Company involved

Flock Safety

AI system involved

Flock FreeForm

1 source article · read the reporting →

Iraq War Veteran Claims Flock Camera Error Led to Police Stop at Gunpoint - Military.com

The system incorrectly identified a vehicle as stolen, leading to a traffic stop and detention of the driver at gunpoint.

Company involved

Flock Safety

AI system involved

Flock Safety license plate reader

1 source article · read the reporting →

Department of Justice training uses AI chatbot that names real harassment victim

A psychosocial safety training course at Bunbury prison, commissioned by the Western Australia Department of Justice, used a scenario generated by Microsoft Copilot that included the real name of former employee Bronwyn Hendry, an alleged sexual harassment victim. The trainer said she was unaware the AI had used a real person's name. Ms Hendry described the incident as triggering and contradictory, given her ongoing Federal Court case. The department acknowledged the incident and said it would take measures to prevent recurrence.

Company involved

Department of Justice, Western Australia

AI system involved

Microsoft Copilot

1 source article · read the reporting →

St George's admissions algorithm biased against women and ethnic minorities

In the late 1970s and 1980s, St George's Hospital Medical School used a computer algorithm to automate the first round of its admissions process, scoring applicants based on historical data. The model was found to discriminate against female applicants and those with non-European-looking names, denying them interviews. The bias was discovered by two professors, and the university co-operated with a Commission for Racial Equality inquiry, subsequently contacting affected applicants and offering some places.

Company involved

St George's Hospital Medical School

4 source articles · read the reporting →

EasyMile ordered to stop carrying passengers after injury in Ohio

A passenger was injured while riding in an EasyMile self-driving shuttle in Columbus, Ohio, when the vehicle made an emergency stop from 7 mph, causing the passenger to fall from their seat. The passenger sought medical attention, and the local transportation project Smart Columbus halted the service. The National Highway Traffic Safety Administration (NHTSA) partially suspended EasyMile's US operations, prohibiting the company from carrying passengers while it investigates the incident.

Company involved

EasyMile

3 source articles · read the reporting →

Stanford vaccine algorithm excluded frontline resident doctors

Resident physicians at Stanford Medical Center protested after only seven out of over 1,300 were prioritised for the first 5,000 doses of the COVID-19 vaccine. Hospital leadership blamed the unequal distribution plan on a "very complex algorithm", which used a points-based formula that researchers suspect used flawed proxies for COVID-19 risk. The algorithm reportedly failed to account for direct patient exposure and disadvantaged rotating residents. Following widespread backlash, Stanford apologised and stated it would revise its distribution plan, while some residents obtained vaccinations elsewhere.

Company involved

Stanford Medical Center

5 source articles · read the reporting →

Montefiore Allegedly Plans to Replace Nurses with AI for Insurance Reviews

The New York State Nurses Association alleges that Montefiore Health System plans to lay off 12 utilization review nurses and replace them with AI-powered software from Datavant. The union warns that the move could compromise patient care by having AI review insurance denials without clinical judgement. Montefiore denies the claims, stating they are investing in technology for better outcomes. The plan has sparked a town hall and calls from elected officials to halt the layoffs.

Company involved

Montefiore Health System

3 source articles · read the reporting →

ScotRail replaces AI announcer after voice cloning dispute

ScotRail launched a new AI onboard announcer using the voice of an employee, Vannessa Sloan, after voiceover artist Gayanne Potter alleged her voice was used without permission to train the previous AI announcer, Iona. Potter claimed she was told her recordings for ReadSpeaker would be used for accessibility software, not commercial purposes. The new system uses Sloan's voice and is described by ScotRail as 'ethically produced'.

Company involved

ScotRail

AI system involved

Iona

6 source articles · read the reporting →

Rep. Anna Paulina Luna denies staff used AI to draft defence amendment

Rep. Anna Paulina Luna's congressional office used Claude, an AI chatbot, to spellcheck and grammar-check a summary of an amendment to the 2027 National Defense Authorization Act. Screenshots of the summary circulated online because it still contained the text 'Claude responded:'. Luna initially said staff used AI to correct draft text and did not edit it, then clarified that AI was only used on the summary and that no legislation is drafted with AI. The incident drew public speculation about AI use in legislative work.

Company involved

Office of Rep. Anna Paulina Luna

AI system involved

Claude

2 source articles · read the reporting →