Where automated decisions went wrong

People Training OpenAI’s AI Fired for Using AI to Train the AI - 404 Media

Contractors were fired for using AI to complete their work.

Company involved

Mercor

1 source article · read the reporting →

Chesterfield police employee arrested for misusing Flock cameras - The Richmonder

The system allowed unauthorized searches of license plate data, affecting individuals whose plates were queried.

Company involved

Chesterfield County Police Department

AI system involved

Flock Safety Automatic License Plate Reader System

1 source article · read the reporting →

First Accident Before Test Phase: Robotaxis Launch in Furttal

Erster Unfall, bevor die Testphase beginnt: Robotaxis starten im Furttal - nzz.ch

Switzerland's first self-driving taxi service launched in the Furttal region near Zurich, but three days before the start a test vehicle had a minor accident in Dänikon, damaging a ground plate and two tires. The pilot project, called Iamo, aims to complement public transport, with a safety driver on board during the test phase.

Company involved

Swiss Transit Lab

1 source article · read the reporting →

Tesla on Autopilot hits Florida Highway Patrol cruiser in Orlando

A Tesla using its partially automated Autopilot system struck a Florida Highway Patrol cruiser on an interstate near Orlando on August 28, 2021. The trooper had activated emergency lights and was assisting a disabled vehicle. The Tesla driver and the driver of the disabled vehicle suffered minor injuries; the trooper was unhurt. The National Highway Traffic Safety Administration had previously opened an investigation into Tesla's Autopilot after similar collisions with emergency vehicles.

Company involved

Tesla

AI system involved

Autopilot

10 source articles · read the reporting →

Tesla Employee Dies in Full Self-Driving Crash in Colorado Mountains

Hans von Ohain, a Tesla recruiter, died when his Model 3 crashed into a tree and caught fire while using Tesla's Full Self-Driving feature on a mountain road in Colorado. His widow, Nora Bass, criticised Tesla for lack of response, saying they were treated like 'guinea pigs'. Investigators noted that Ohain's blood alcohol was over three times the legal limit, but the crash did not show typical signs of drunk driving, suggesting the driver-assistance feature was active. Tesla has not commented on the incident.

Company involved

Tesla

AI system involved

Full Self-Driving

10 source articles · read the reporting →

Tesla Vehicle Strikes Parked Firetruck, Killing Passenger

On 29 December 2019, a Tesla crashed into a parked firetruck on Interstate 70 in Indiana, killing 23-year-old passenger Jenna Monet and seriously injuring the driver. Police have not yet confirmed whether Tesla's Autopilot driver-assist system was in use at the time. The incident is the latest in a series of similar crashes involving Tesla vehicles colliding with stationary emergency vehicles.

Company involved

Tesla

AI system involved

Tesla Autopilot

5 source articles · read the reporting →

Tesla Model S crashes into firetruck with Autopilot engaged, driver injured

A Tesla Model S driver in South Jordan, Utah, crashed into a parked firetruck while the car's Autopilot system was engaged, according to police. The driver, a 28-year-old woman, admitted she was looking at her phone before the collision. Tesla stated it had not yet received data from the car and could not confirm whether Autopilot was on. The driver suffered a broken ankle and was taken to hospital.

Company involved

Tesla

AI system involved

Autopilot

10 source articles · read the reporting →

Software flaw misclassified women as children on Tui flight

A software flaw in Tui's reservation system misclassified 38 adult female passengers as children due to a language difference where 'Miss' is used for children in the programming country. This led to incorrect weight calculations for take-off on a flight from Birmingham to Majorca on 21 July 2020. The AAIB report stated that the safe operation of the aircraft was not compromised, and Tui corrected the fault.

Company involved

Tui

AI system involved

Reservation system

10 source articles · read the reporting →

Midjourney generates biased images of Black African doctors treating white children

Researchers asked Midjourney to generate images of Black African doctors treating white children, but the AI consistently depicted the children as Black and sometimes the doctors as white, reinforcing racial stereotypes. The experiment, published in Lancet Global Health, highlights how AI image generators perpetuate biases from their training data. Midjourney did not respond to requests for comment.

AI system involved

Midjourney

5 source articles · read the reporting →

Nio ES8 fatal crash with Nio Pilot on highway in China

On August 12, 2021, a Nio ES8 with Nio Pilot active struck a stationary highway maintenance vehicle on a highway in Putian, Fujian, killing the 31-year-old driver. The system failed to detect the stationary obstacle. The driver's family alleged Nio employees tampered with data from the crashed vehicle, which Nio denied. The cause remains under investigation by local police.

Company involved

Nio

AI system involved

Nio Pilot

10 source articles · read the reporting →

Mahindra Racing partners with AI woman Ava Rose as ambassador, drawing criticism

Mahindra Racing, a Formula E team, announced a partnership with Ava Rose, an AI-generated woman, to serve as its 'artificial intelligence ambassador' for the season. The team is accused of avoiding hiring a real woman for the role, drawing criticism from women in motorsport and others. The AI persona, who has an Instagram presence, will engage with fans and share behind-the-scenes content. Mahindra Racing has not responded publicly to the backlash.

Company involved

Mahindra Racing

AI system involved

Ava Rose

7 source articles · read the reporting →

Driver Assistance Blamed Again: Station Wagon Hits Crash Cushion on Highway 1, Two Hurt

輔助駕駛又釀禍！國1銅鑼段旅行車追撞緩撞車 駕駛乘客2人受傷 - 自由時報

A Volvo station wagon using driver assistance rear-ended a crash cushion vehicle on National Highway 1 in Tongluo, Miaoli County. The driver and a passenger sustained minor injuries. The driver was not paying attention to the road ahead.

1 source article · read the reporting →

Delta’s AI Told A Passenger Her Flight Home Was Safe, Then Canceled It And Demanded Double To Rebook - View…

The AI canceled the passenger's entire roundtrip award ticket, including the return flight, after the passenger requested only the outbound be canceled.

Company involved

Delta Air Lines

AI system involved

Delta Concierge

1 source article · read the reporting →