The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

68 incidents closest to “Nurse Co-Pilot” · matched on meaning · public reporting

WF-KVS2HV4 Oct 2025

Florida woman sues highway patrol after Flock data falsely identified her - NewsNation

Flock camera data falsely identified Lindsey Isaacs as the driver in a fatal hit-and-run, leading to her arrest and felony charges.

Company involved
Flock Safety
AI system involved
Flock Safety

1 source article · read the reporting →

WF-ZOA0XK25 Jul 2026French

Tesla’s Autopilot Reportedly Involved in Another Accident

L’Autopilot de Tesla serait impliqué dans un nouvel accident, voici ce qu’il s’est passé - PaperGeek

Kyle Shanahan, coach of the San Francisco 49ers, crashed his Tesla. He suspects the Autopilot may have malfunctioned, but is unsure if he accidentally deactivated it. He stressed that drivers must always remain vigilant and ready to take over.

Company involved
Tesla
AI system involved
Autopilot

1 source article · read the reporting →

WF-6LRXJJ19 Aug 2026ZH-TW

3 Dead, 2 Injured in Highway Secondary Crash; Police Suspect Assisted Driving, Transportation Safety Board Opens Investigation

國道3死2傷二次事故 警疑輔助駕駛釀禍 運安會:重大事故立案調查 - UDN

On August 19, a secondary crash on Taiwan's National Highway 1 in Miaoli killed three people and injured two. After a minor collision, two drivers stood between their cars in the inner lane without taking safety measures, and a third vehicle using an assisted driving system rear-ended them. The Transportation Safety Board has launched a major accident investigation.

1 source article · read the reporting →

St George's admissions algorithm biased against women and ethnic minorities

In the late 1970s and 1980s, St George's Hospital Medical School used a computer algorithm to automate the first round of its admissions process, scoring applicants based on historical data. The model was found to discriminate against female applicants and those with non-European-looking names, denying them interviews. The bias was discovered by two professors, and the university co-operated with a Commission for Racial Equality inquiry, subsequently contacting affected applicants and offering some places.

Company involved
St George's Hospital Medical School

4 source articles · read the reporting →

WF-5LZUWJ19 Feb 2020

EasyMile ordered to stop carrying passengers after injury in Ohio

A passenger was injured while riding in an EasyMile self-driving shuttle in Columbus, Ohio, when the vehicle made an emergency stop from 7 mph, causing the passenger to fall from their seat. The passenger sought medical attention, and the local transportation project Smart Columbus halted the service. The National Highway Traffic Safety Administration (NHTSA) partially suspended EasyMile's US operations, prohibiting the company from carrying passengers while it investigates the incident.

Company involved
EasyMile

3 source articles · read the reporting →

Google Translate erases female historians and male nurses due to gender bias

An experiment by AlgorithmWatch found that Google Translate systematically changes the gender of occupation words when translating between gender-inflected languages, using English as a bridge. Female historians were rendered as male, and male nurses as female, reinforcing stereotypes. Google acknowledged the issue, explaining that gender is lost when translating to English, the bridging language. The feature affects hundreds of millions of European users who cannot easily avoid Google Translate on Android and Chrome.

Company involved
Google
AI system involved
Google Translate

10 source articles · read the reporting →

WF-6Y2BKK18 Dec 2020

Stanford vaccine algorithm excluded frontline resident doctors

Resident physicians at Stanford Medical Center protested after only seven out of over 1,300 were prioritised for the first 5,000 doses of the COVID-19 vaccine. Hospital leadership blamed the unequal distribution plan on a "very complex algorithm", which used a points-based formula that researchers suspect used flawed proxies for COVID-19 risk. The algorithm reportedly failed to account for direct patient exposure and disadvantaged rotating residents. Following widespread backlash, Stanford apologised and stated it would revise its distribution plan, while some residents obtained vaccinations elsewhere.

Company involved
Stanford Medical Center

5 source articles · read the reporting →

WF-836B9A23 Jun 2025

Navy unmanned vessel capsizes support boat during test off California coast

On 23 June 2025, during a U.S. Navy test of an unmanned surface vessel near Channel Islands Harbor, California, the drone received an inadvertent command that caused it to accelerate and capsize a support boat. The tugboat captain was thrown into the water but was rescued by emergency responders and declined medical attention. The Navy halted the test, conducted a safety stand-down, and is implementing additional safety procedures. A preliminary investigation indicated the incident was caused by the inadvertent command, though it is unclear whether it originated from a human or technical malfunction.

Company involved
U.S. Navy

1 source article · read the reporting →

WF-LYHNTC1 Jul 2026

Montefiore Allegedly Plans to Replace Nurses with AI for Insurance Reviews

The New York State Nurses Association alleges that Montefiore Health System plans to lay off 12 utilization review nurses and replace them with AI-powered software from Datavant. The union warns that the move could compromise patient care by having AI review insurance denials without clinical judgement. Montefiore denies the claims, stating they are investing in technology for better outcomes. The plan has sparked a town hall and calls from elected officials to halt the layoffs.

Company involved
Montefiore Health System

3 source articles · read the reporting →

WF-CNQ4DH1 Nov 2025

AI-generated influencer Jessica Foster mixes political propaganda with OnlyFans monetisation

An AI-generated Instagram persona named Jessica Foster, presented as a US soldier and 'America First' supporter, has gained a million followers through patriotic and suggestive content. The account is linked to an OnlyFans profile that monetises the audience, and its creator is not identified. The article reports that the realistic AI content is difficult to distinguish from reality and raises concerns about trust and ethics.

AI system involved
Jessica Foster

4 source articles · read the reporting →

WF-N3FWDJ4 Mar 2026

国内ベンチャー企業A社、AIなりすまし面談で実在エンジニアになりすまされる

A domestic Japanese logistics SaaS venture, referred to as Company A, conducted an online casual interview for an engineer role on 4 March 2026. An applicant used AI-generated video to impersonate a real engineer, Yoshii Kenbun, whose CV details had been submitted without his knowledge. The interviewer noticed discrepancies in language ability and unnatural video, and the company confirmed with Yoshii that he had not applied or attended. Company A and Yoshii publicised the incident on X the next day.

3 source articles · read the reporting →

WF-RB56A71 Jun 2025

ScotRail replaces AI announcer after voice cloning dispute

ScotRail launched a new AI onboard announcer using the voice of an employee, Vannessa Sloan, after voiceover artist Gayanne Potter alleged her voice was used without permission to train the previous AI announcer, Iona. Potter claimed she was told her recordings for ReadSpeaker would be used for accessibility software, not commercial purposes. The new system uses Sloan's voice and is described by ScotRail as 'ethically produced'.

Company involved
ScotRail
AI system involved
Iona

6 source articles · read the reporting →

Rep. Anna Paulina Luna denies staff used AI to draft defence amendment

Rep. Anna Paulina Luna's congressional office used Claude, an AI chatbot, to spellcheck and grammar-check a summary of an amendment to the 2027 National Defense Authorization Act. Screenshots of the summary circulated online because it still contained the text 'Claude responded:'. Luna initially said staff used AI to correct draft text and did not edit it, then clarified that AI was only used on the summary and that no legislation is drafted with AI. The incident drew public speculation about AI use in legislative work.

Company involved
Office of Rep. Anna Paulina Luna
AI system involved
Claude

2 source articles · read the reporting →

Babylon Health attacks clinician who raised safety concerns about its AI chatbot

Dr David Watkins, a consultant oncologist, publicly raised concerns about Babylon Health's symptom triage chatbot, alleging it missed critical conditions such as heart attacks in women. Babylon Health issued a press release attacking Watkins as a 'troll' and manipulating data to discredit his testing. Watkins denies the claims and has filed complaints with the MHRA, which remain pending.

Company involved
Babylon Health

6 source articles · read the reporting →

Nurse at St. Rose Dominican Hospital Averts AI-Sepsis Alert Error

A nurse at St. Rose Dominican Hospital in Henderson, Nevada, refused to follow an AI-generated sepsis alert that would have given an elderly dialysis patient IV fluids, which could have caused a life-threatening complication. The alert, part of the hospital's electronic system, prompted a charge nurse to order the fluids despite the patient's compromised kidneys. A physician intervened and ordered dopamine instead, averting harm. The incident highlights concerns about AI tools overriding clinical judgment.

Company involved
St. Rose Dominican Hospital

1 source article · read the reporting →

Google's Nightingale project transfers medical data of millions without patient knowledge

An anonymous Google whistleblower states that the company acquired medical data of 50 million patients from Ascension without their knowledge. The transfer, known as Project Nightingale, raised privacy and security concerns. The article reports that a federal inquiry was launched into whether HIPAA protections were followed.

Company involved
Google

10 source articles · read the reporting →

WF-SJQIT13 Mar 2019

Kaiser Permanente doctor delivers terminal diagnosis via robot video screen

Ernest Quintana, 79, was admitted to Kaiser Permanente Medical Center in Fremont, California, with failing lungs. A doctor appeared on a telepresence robot's video screen and told him he might not make it home. The family was devastated that the news was delivered through a machine rather than in person. Kaiser Permanente issued a statement expressing regret and said it would review its practices.

Company involved
Kaiser Permanente

10 source articles · read the reporting →

WF-VYTMB621 Dec 2022

Southwest Airlines holiday meltdown due to crew scheduling software failure

In December 2022, Southwest Airlines experienced a catastrophic operational meltdown after its crew scheduling software failed to assign pilots and flight attendants to flights during a winter storm. The system, SkySolver and Crew Web Access, could not handle the volume of schedule changes, leading to over 15,800 flight cancellations and stranding thousands of passengers and crew. Southwest's CEO acknowledged the technology failure and promised upgrades, but the incident remained unresolved at the time of reporting.

Company involved
Southwest Airlines
AI system involved
SkySolver and Crew Web Access

10 source articles · read the reporting →

NHTSA investigates Tesla Autopilot over 11 crashes with first responder vehicles

The US National Highway Traffic Safety Administration (NHTSA) has opened an investigation into Tesla's Autopilot system after identifying 11 crashes in which Tesla vehicles collided with first responder vehicles. In each incident, the vehicles were confirmed to have Autopilot or Traffic-Aware Cruise Control engaged. Most crashes occurred after dark and involved scene control measures such as lights, flares, and road cones. NHTSA will assess the system's ability to monitor driver engagement and handle emergency scenes.

Company involved
Tesla Inc.
AI system involved
Autopilot

10 source articles · read the reporting →

Dartmouth Medical School charges 17 students with cheating based on tracking system.

Dartmouth College's Geisel School of Medicine charged 17 students with cheating on remote exams during the pandemic. The charges were based on secret tracking of student activity on the learning management system. Critics say the system is prone to errors and inappropriate for monitoring students.

Company involved
Dartmouth College Geisel School of Medicine

10 source articles · read the reporting →

WF-OD83P526 May 2021

Google and HCA Healthcare partner to analyze 32 million patient records

Google Cloud has announced a partnership with HCA Healthcare to analyze around 32 million patient records. The anonymized data will be used to develop algorithms that could advise doctors on treatment options. Privacy advocates have raised concerns about the data sharing and the potential for AI to re-identify patients. HCA insists that patient-identifiable information will be stripped and that access will be tightly controlled.

Company involved
HCA Healthcare
AI system involved
Google Cloud

9 source articles · read the reporting →

WF-0TNQZD17 Aug 2023

Cruise robotaxi hits San Francisco fire truck, one injured

A Cruise self-driving car collided with a San Francisco Fire Department truck that was responding to an emergency. The incident occurred on August 17, 2023, in the Tenderloin district. One passenger sustained non-severe injuries and was taken to hospital. Cruise acknowledged the crash and offered support to the rider.

Company involved
Cruise
AI system involved
Cruise self-driving car

10 source articles · read the reporting →

WF-YPK67D1 Feb 2021

NHS QCovid algorithm incorrectly labels young patients as high risk, causing vaccine call-up

The article reports that scientists are questioning the reliability of the QCovid risk prediction algorithm used by the NHS to prioritise COVID-19 vaccinations. Due to missing data on weight or ethnicity, the algorithm automatically assigns a high BMI and high-risk ethnicity, leading to young, healthy patients being incorrectly labelled as high risk and called for early vaccination. GPs have identified hundreds of such cases, causing anxiety and potentially delaying vaccinations for more vulnerable individuals. NHS Digital acknowledged the issue and said clinicians can remove patients from the shielding list.

Company involved
NHS
AI system involved
QCovid

10 source articles · read the reporting →

Cruise alleged to rely on human operators for autonomous driving

A New York Times article alleged that Cruise's autonomous vehicles rely on human operators to achieve autonomous driving, with 1.5 workers per vehicle intervening every 2.5 to five miles. Cruise CEO Kyle Vogt responded on Hacker News, stating that remote assistance is used 2-4% of the time and that many sessions are resolved by the vehicle itself. The company declined an interview request from the NYT.

Company involved
Cruise
AI system involved
Cruise AV

9 source articles · read the reporting →

← Newerpage 2 of 3Older →