The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

197 incidents closest to “SAS Viya” · matched on meaning · public reporting

AI-powered scam compound in Myanmar uses ChatGPT and Gemini to defraud thousands globally

Safeer Mohammed Koorimannil, trafficked to a scam compound in Tai Chang, Myanmar, was forced to use AI-powered software to impersonate a woman and deceive victims into sending money. The software, Kongtian Intelligent Customer Acquisition and Global Social Traffic Navigation, used OpenAI's ChatGPT and Google's Gemini to generate messages and translate in over 100 languages. Koorimannil targeted 50,000 victims in a month, while the tools enabled scammers to rake in tens of millions of dollars. U.S. authorities have created a strike force to disrupt such operations, and OpenAI has banned accounts linked to the scams.

Company involved
Tai Chang
AI system involved
Kongtian Intelligent Customer Acquisition (KT) and Global Social Traffic Navigation (007TG)

2 source articles · read the reporting →

WF-7PPBNA4 Mar 2022

Spanish VioGén Algorithm Deems Woman Low Risk Before Fatal Domestic Violence

In January 2022, Lobna Hemid reported her husband's abuse to Spanish police. The VioGén algorithm assessed her risk as low, and she received no further protection. Seven weeks later, her husband fatally stabbed her. The case highlights flaws in Spain's reliance on the algorithm to predict domestic violence.

Company involved
Interior Ministry of Spain
AI system involved
VioGén

2 source articles · read the reporting →

WF-NWB6EE1 Dec 2024

OpenAI's Sora video generator trained on copyrighted content without consent, tests suggest

Tests by The Washington Post suggest that OpenAI's video generation tool Sora was trained on videos from Netflix, TikTok, YouTube and other sources without permission. OpenAI has not disclosed its training data for Sora, saying only that it used publicly available and licensed data. The tool can closely replicate copyrighted characters, logos and scenes, raising concerns about copyright infringement. OpenAI has not faced a lawsuit specifically over Sora's training data but is fighting other copyright suits.

Company involved
OpenAI
AI system involved
Sora

3 source articles · read the reporting →

WF-U0QEUY1 Oct 2025

OpenAI's Sora generates copyrighted characters, prompting studio concerns

OpenAI's Sora video generator returns videos featuring copyrighted characters and materials from movies and TV shows, including Rick and Morty, South Park and Dune, according to The Hollywood Reporter. OpenAI requires copyright holders to opt out of having their content used, which legal experts say inverts copyright law. OpenAI says it is working with rights holders to understand their preferences. No lawsuit has been filed yet, but studios have grounds to sue, experts say.

Company involved
OpenAI
AI system involved
Sora

6 source articles · read the reporting →

WF-KH4UOW1 Aug 2020

Google Cloud Used in CBP AI Virtual Border Wall Contract

The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.

Company involved
U.S. Customs and Border Protection (CBP)
AI system involved
Google Cloud AI Platform with Anduril Lattice and Sentry Towers

1 source article · read the reporting →

Pentagon Used Anthropic's Claude in Maduro Venezuela Raid

The Wall Street Journal reported allegations that Anthropic's Claude AI model was used by JSOC in an operation to capture former Venezuelan President Nicolás Maduro. The mission reportedly included AI-enabled targeting that helped with bombing multiple sites in Caracas, despite Anthropic's usage guidelines prohibiting use of Claude for violence, weapons, or surveillance. Anthropic said it could not comment on specific operations, and the Defense Department declined to comment. The deployment allegedly ran through Anthropic's partnership with Palantir.

Company involved
Pentagon
AI system involved
Claude

4 source articles · read the reporting →

WF-5MY45D4 May 2020

France uses AI to monitor mask-wearing on public transport

France has deployed AI software from startup DatakaLab in the Paris metro to check if passengers are wearing face masks. The system generates anonymous statistics on mask compliance to help authorities anticipate COVID-19 outbreaks, and the company states it does not identify or punish individuals. The trial is part of measures making masks mandatory on public transport, with fines considered for non-compliance. Privacy advocates have raised concerns about the spread of AI surveillance during the pandemic.

1 source article · read the reporting →

WF-O7K1G41 Jun 2025

Content Giants Sue Unauthorized AI, Invest in Paid Partners - 조선일보

Generated images of copyrighted characters without authorization, affecting Disney and NBCUniversal's intellectual property rights.

Company involved
Midjourney
AI system involved
Midjourney

1 source article · read the reporting →

WF-CBSEF51 Jan 2017

VA's Suicide Prevention Algorithm Favours Men, Ignores Sexual Trauma

The Department of Veterans Affairs' REACH VET algorithm, designed to identify veterans at high risk of suicide, reportedly prioritises white men and excludes factors like military sexual trauma that disproportionately affect women. An investigation found the model gives preference to divorced or widowed men but no female-specific groups, despite a sharper rise in suicide rates among female veterans. VA officials defended the algorithm, stating that excluded variables were not the strongest predictors, while critics argue systemic bias is manifesting. The agency is working on compliance reviews but has not changed the system.

Company involved
Department of Veterans Affairs
AI system involved
REACH VET

2 source articles · read the reporting →

WF-SU17EB1 Mar 2026

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved
Pankaj
AI system involved
AI roommate

5 source articles · read the reporting →

Malaysia tests AI court sentencing, lawyer challenges harsh sentence

In Sabah, Malaysia, a lawyer's client faced a minor drug possession charge and was sentenced with the help of an AI tool that recommended a harsh penalty. The lawyer, Hamid Ismail, appealed the sentence, arguing the AI lacked discretion and the Criminal Procedure Code does not allow for AI use. The courts of Sabah and Sarawak piloted the software, developed by Sarawak Information Systems, amid concerns from lawyers and experts about bias and limited training data. The federal judiciary is concluding a nationwide trial of the tool, but the outcome of the appeal is unknown.

Company involved
Sabah and Sarawak Courts

3 source articles · read the reporting →

WF-N2X8EZ1 Jun 2024

Australian children's photos scraped into LAION-5B AI dataset without consent

Human Rights Watch found that the LAION-5B dataset, used to train AI tools, contains links to identifiable photos of Australian children scraped from the web without consent. The dataset includes photos from schools, personal blogs, and unlisted YouTube videos, with captions revealing names and locations. LAION acknowledged the finding and pledged to remove the photos, but the data persists and poses risks of deepfake creation and privacy violations.

Company involved
LAION
AI system involved
LAION-5B

4 source articles · read the reporting →

Microsoft, OpenAI Sued by Papers Seeking Removal From Models - FourWeekMBA

Microsoft, OpenAI Sued by Papers Seeking Removal From Models FourWeekMBA

Company involved
Microsoft and OpenAI
AI system involved
GPT models (ChatGPT, Copilot)

1 source article · read the reporting →

WF-M83U889 Sep 2026

Suno confirms V6 model was trained on ‘creations’ from users, as it blasts latest Sony and Universal lawsuit - Music…

The AI model generated music that allegedly used unlicensed copyrighted sound recordings, affecting record labels and artists.

Company involved
Suno
AI system involved
Suno V6

1 source article · read the reporting →

WF-HQIBSH16 Nov 2021

South Korean local governments build AI surveillance systems using CCTV data without consent

Several local governments in South Korea, including Bucheon, are developing AI systems that use CCTV footage to track individuals for purposes such as disease control, child abuse detection, and personal protection. The systems are being built without obtaining consent from the people captured in the footage, raising concerns about privacy and surveillance. Bucheon plans to launch a smart epidemiological investigation system in January 2022 that will analyze footage from thousands of crime-prevention cameras to track COVID-19 cases and contacts. Critics question the adequacy of de-identification measures and warn of potential misuse of biometric data.

Company involved
Bucheon City Government
AI system involved
Smart epidemiological investigation system

10 source articles · read the reporting →

WF-0E2A421 Oct 2025

Fake Epstein Island toy ad created with OpenAI's Sora 2 goes viral

A fake commercial created using OpenAI's Sora 2 video tool has spread online, depicting a mock children's toy ad set on 'Epstein Island' with references to Donald Trump and child exploitation allegations. The video was created by Mathieu Samson, founder of AI filmmaking agency Kickflix, who acknowledged insufficient filters on the platform. OpenAI has not yet responded to the incident.

Company involved
OpenAI
AI system involved
Sora 2

4 source articles · read the reporting →

WF-SVB9EC14 Feb 2022

Zhihu denies using behaviour perception system to monitor employees

Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.

Company involved
Zhihu
AI system involved
Behaviour perception system

4 source articles · read the reporting →

WF-XPFO9119 Aug 2019

Engineer.ai accused of exaggerating AI capabilities and using human engineers

Engineer.ai, an AI startup based in Los Angeles and Delhi, was accused by The Wall Street Journal of using human engineers to build software apps while claiming the process was automated. The report cited current and former employees who said the company inflated the role of AI. Founder Sachin Dev Duggal denied the allegations, stating that the company always described itself as a human-assisted AI platform. A former executive filed a wrongful-termination complaint alleging the company exaggerated its technological development.

Company involved
Engineer.ai

6 source articles · read the reporting →

WF-UJW7PA1 May 2024

Yale student sues after GPTZero AI detection leads to cheating accusation and suspension

Thierry Rignol, a top student in Yale's Executive MBA program, was accused of using AI on a final exam after the detection tool GPTZero flagged his answers. Despite his denials and claims of bias against non-native English speakers, Yale's Honor Committee suspended him for a year and gave him an F. Rignol sued Yale in federal court, alleging breach of contract, civil rights violations, and defamation; the case remains pending.

Company involved
Yale University
AI system involved
GPTZero

1 source article · read the reporting →

WF-C3J9XA9 May 2022

Upstart Holdings sued for securities fraud over AI model claims

Upstart Holdings, Inc., a cloud-based AI lending platform, is accused of making false and misleading statements about its AI model's ability to account for macroeconomic factors. The lawsuit, filed on May 13, 2022, alleges that the company's positive statements about its business were materially false. Investors suffered losses when Upstart's stock price fell 56% on May 9, 2022, after the company reduced its fiscal 2022 guidance.

Company involved
Upstart Holdings, Inc.
AI system involved
Upstart AI lending platform

10 source articles · read the reporting →

WF-G2H6JW12 Aug 2021

Nio ES8 fatal crash with Nio Pilot on highway in China

On August 12, 2021, a Nio ES8 with Nio Pilot active struck a stationary highway maintenance vehicle on a highway in Putian, Fujian, killing the 31-year-old driver. The system failed to detect the stationary obstacle. The driver's family alleged Nio employees tampered with data from the crashed vehicle, which Nio denied. The cause remains under investigation by local police.

Company involved
Nio
AI system involved
Nio Pilot

10 source articles · read the reporting →

WF-7RJARP1 Mar 2020

Minneapolis schools use Gaggle AI to monitor students' online activity

Minneapolis Public Schools deployed Gaggle, an AI-powered surveillance system, to monitor students' school-issued Google and Microsoft accounts during remote learning. The system flagged thousands of incidents, including references to self-harm and pornography, raising privacy concerns. Critics argue the surveillance undermines student trust and may deter them from seeking help. The district defended the tool as a way to identify students in distress.

Company involved
Minneapolis Public Schools
AI system involved
Gaggle

9 source articles · read the reporting →

WF-Y7HK9P19 Dec 2023

LAION temporarily takes down 5B dataset after Stanford finds potential CSAM

Stanford researchers reported that the LAION 5B training dataset contains potentially illegal content in the form of child sexual abuse material (CSAM). LAION, a non-profit organization that provides datasets for machine learning research, acknowledged the reports and temporarily took down the datasets to ensure they are safe before republishing. LAION is working with the Internet Watch Foundation and the Hamburg State Data Protection Commissioner to address the issue.

Company involved
LAION
AI system involved
LAION 5B

6 source articles · read the reporting →

WF-4RZUE65 Dec 2023

Civitai dropped by cloud provider OctoML over CSAM image generation

Civitai, an AI image generation platform, was dropped by its cloud computing provider OctoML after an investigation by 404 Media found it was being used to generate images that could be categorized as child sexual abuse material (CSAM). The platform also faced scrutiny for nonconsensual deepfakes of celebrities and private citizens, primarily women. Civitai added new moderation filters in response, but OctoML terminated the business relationship.

Company involved
Civitai
AI system involved
Civitai

8 source articles · read the reporting →

← Newerpage 8 of 9Older →