The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

140 incidents closest to “Canvas Studio” · matched on meaning · public reporting

WildBrain disputes Kartoon Studios' Gadget A.I. trademark use

Kartoon Studios announced its Gadget A.I. toolkit, which aggregates AI tools for animation production. WildBrain, which owns the Inspector Gadget IP, publicly stated that Kartoon lacks the rights to use the character's branding and requested its removal. Kartoon responded claiming it had secured a license, and both companies are in discussions.

Company involved
Kartoon Studios
AI system involved
Gadget A.I.

2 source articles · read the reporting →

OpenAI's ChatGPT generates political campaign messages despite own rules

OpenAI's ChatGPT has been generating tailored political campaign messages, violating the company's own rules. The Washington Post analysis found that OpenAI has not enforced its ban for months. The chatbot can create messages targeting specific demographics like suburban women and urban dwellers. OpenAI acknowledged the difficulty of enforcing the rules and is seeking suggestions.

Company involved
OpenAI
AI system involved
ChatGPT

9 source articles · read the reporting →

WF-9FPGGA31 May 2024

Adobe Stock offers AI-generated images inspired by Ansel Adams, violating its own ethics policy

The estate of Ansel Adams publicly criticised Adobe for offering AI-generated images on Adobe Stock that were 'inspired by' Adams' work, violating Adobe's own contributor terms that prohibit using artist names in prompts. Adobe acknowledged the violation and removed the images, but the estate claimed it had contacted the company multiple times since August 2023 without resolution.

Company involved
Adobe
AI system involved
Adobe Stock

4 source articles · read the reporting →

WF-OS2JRK21 Feb 2024

Meta’s BlenderBot 3 chatbot generates offensive content publicly.

Meta released its AI chatbot BlenderBot 3 for public testing in February 2024. Users reported that the chatbot generated anti-Semitic, racist, and conspiratorial responses. Meta acknowledged the flaws and said public feedback is essential for improvement. The incident reignited debate about the ethics of releasing underdeveloped AI systems.

Company involved
Meta
AI system involved
BlenderBot 3

6 source articles · read the reporting →

WF-RLP6881 Apr 2023

Xiaohongshu accused of using illustrators' artwork to train its AI

Illustrators accused Xiaohongshu, a Chinese lifestyle platform, of using their artwork without permission to train its AI image generator, Trik AI. The company privately apologized to one illustrator, surnamed Xue, and admitted the artwork was used, but claimed it came from open access sources rather than users' accounts. The illustrators have boycotted the platform until their concerns are addressed, amid ongoing debates over AI and copyright in China.

Company involved
Xiaohongshu
AI system involved
Trik AI

7 source articles · read the reporting →

WF-6BIZTN1 Mar 2014

Duke University recorded students' faces without proper consent for public dataset

In March 2014, Duke University researchers recorded thousands of students walking to class on campus without their knowledge or proper consent, creating the DukeMTMC dataset of over 2 million image frames. The dataset was placed on a public website and downloaded by academics, security contractors, and military researchers globally, including Chinese companies and military academies linked to surveillance of ethnic minorities. The university took down the public website in April 2019 after an Institutional Review Board investigation found the study deviated significantly from the approved protocol. The lead researcher apologized, stating he took full responsibility for his mistakes.

Company involved
Duke University
AI system involved
DukeMTMC

10 source articles · read the reporting →

WF-AW8J1O1 Sep 2021

Audit of LAION-400M finds sexual violence, racial slurs, and stereotypes in dataset

An audit of the LAION-400M dataset by Abeba Birhane and colleagues at University College Dublin and University of Edinburgh found that its automated curation using CLIP failed to remove sexually explicit images, racial slurs, and stereotypes. The authors' queries for terms like 'latina', 'Korean', and 'Indian' returned pornography and sexual violence, while 'CEO' returned only men and 'terrorist' returned images of Middle Eastern men. The dataset's compilers used CLIP to filter web-scraped image-text pairs, but CLIP's own web-trained biases allowed harmful content through. The findings raise concerns that models trained on LAION-400M would inherit these shortcomings.

Company involved
LAION-400M team
AI system involved
LAION-400M

7 source articles · read the reporting →

WF-YHUBUO1 Dec 2024

X's Grok AI used to create racist images of football players

In December 2024, X's Grok AI chatbot was used to generate photorealistic racist images of several football players and managers, including depictions of a black player picking cotton and eating bananas with monkeys. The images were created using Grok's new Aurora feature, which has fewer restrictions and can be jailbroken. Online abuse experts warn this is the start of a growing problem, and the Premier League is aware of the images.

Company involved
X
AI system involved
Grok

1 source article · read the reporting →

WF-HCNIXO1 Dec 2007

Oxford Town Centre CCTV dataset used without consent for AI research

The Oxford Town Centre dataset is a CCTV video of pedestrians in Oxford, England, captured from a public surveillance camera without the knowledge or consent of the approximately 2,200 people shown. The footage was used in over 60 research projects, including commercial research by Amazon, Disney, and Huawei, for developing facial recognition, sex classification, and social distancing algorithms. The dataset was taken down in June 2020, but no remediation was provided to the individuals depicted.

Company involved
University of Oxford
AI system involved
Oxford Town Centre dataset

5 source articles · read the reporting →

WF-GEPFGZ1 Dec 2023

OpenDream AI art site allowed users to generate child sexual abuse material

OpenDream, an AI image generation platform, allowed users to generate and publicly display child sexual abuse material (CSAM) and non-consensual deepfakes from at least December 2023 until July 2024. The platform, operated by CBM Media Pte Ltd in Singapore, offered paid plans with NSFW prompts and models. Bellingcat reported the site to the National Center for Missing & Exploited Children. After Bellingcat's inquiry, the CSAM was removed from the site and search engines, and Google terminated OpenDream's AdSense account.

Company involved
CBM Media Pte Ltd
AI system involved
OpenDream

3 source articles · read the reporting →

WF-0MLTX024 Jul 2021

Developer iperov releases DeepFaceLive real-time face-swap AI on GitHub

The developer iperov has published DeepFaceLive, a neural network for real-time face swapping, on GitHub. The tool automatically replaces a user's face in live streams and video calls with a nonexistent model or a celebrity, and the installation instructions are simple. The developer claims 95% of deepfakes on YouTube were made with the related DeepFaceLab. No specific harm is reported, but the article highlights the tool's potential for misuse.

Company involved
iperov
AI system involved
DeepFaceLive

7 source articles · read the reporting →

WF-3NRNF21 Oct 2023

Meta's AI sticker tool generates lewd, rude, and nude images

Meta's new AI-generated sticker feature on Facebook Messenger allowed users to create inappropriate images, including child soldiers, nude politicians, and sexualised characters. The tool, powered by Meta's Llama 2 model, was found to have insufficient content filters, enabling users to bypass restrictions with typos. Meta was contacted for comment but had not responded at the time of reporting.

Company involved
Meta
AI system involved
AI-generated sticker tool

1 source article · read the reporting →

WF-4IX4DQ1 Aug 2023

Wizards of the Coast acknowledges AI-generated art in D&D book, updates policies

Dungeons & Dragons publisher Wizards of the Coast acknowledged that AI-generated artwork was included in its sourcebook 'Bigby Presents: Glory of the Giants', which released digitally on August 1, 2023. The artist, Ilya Shkipin, admitted using AI for 'polish and editing' after community members pointed out inconsistencies. Wizards stated they were unaware of the AI use and are revising artist guidelines to ban AI art going forward. The AI-generated images remain in the digital and physical editions of the book.

Company involved
Wizards of the Coast

9 source articles · read the reporting →

Hollywood studios accuse ByteDance's Seedance 2.0 of mass copyright infringement

The Motion Picture Association, representing major US studios, has accused ByteDance's AI video tool Seedance 2.0 of engaging in unauthorised use of US copyrighted works on a massive scale. The tool generated realistic clips based on films and shows including The Lord of the Rings, Seinfeld, Avengers and Breaking Bad. ByteDance said it had suspended the ability to upload images of real people and would introduce policies to address infringement risks.

Company involved
ByteDance
AI system involved
Seedance 2.0

6 source articles · read the reporting →

WF-4S4IEX27 Mar 2025

OpenAI's ChatGPT generates Studio Ghibli-style images, including offensive content

OpenAI's ChatGPT image generation feature has been used to create images in the style of Studio Ghibli, including offensive recreations of events like 9/11 and the JFK assassination. The company says it allows broader studio styles and has safeguards against living artists, but users have bypassed these. OpenAI says it aims to give users creative freedom while preventing infringement.

Company involved
OpenAI
AI system involved
ChatGPT

4 source articles · read the reporting →

WF-PQ8NMX1 Jan 2022

Stable Diffusion Accused of Stealing Artists' Styles Without Consent

Artists including Greg Rutkowski and Karla Ortiz allege that Stability AI's image generator Stable Diffusion was trained on their work without permission, enabling users to create images mimicking their distinctive styles. The artists express concern that this threatens their livelihoods and identities, as their names become prompts for generating similar art. A tool is being developed to help protect artists from such unauthorised use, but the situation remains unresolved.

Company involved
Stability AI
AI system involved
Stable Diffusion

10 source articles · read the reporting →

ChatGPT 4o image generator used to create fake receipts

ChatGPT's new image generator, part of the 4o model, can generate realistic fake restaurant receipts. Social media users demonstrated the capability, raising concerns about potential fraud. OpenAI stated that images include metadata and that it takes action against policy violations. The company defended the feature as allowing creative freedom.

Company involved
OpenAI
AI system involved
ChatGPT 4o image generator

5 source articles · read the reporting →

WF-H3NHGW1 Jan 2020

GoLaxy Used AI to Manipulate Public Opinion in Hong Kong and Taiwan

The Chinese company GoLaxy used an AI system called Smart Propaganda System (GoPro) to monitor and manipulate public opinion in Hong Kong and Taiwan, according to internal documents. The system collected data on members of Congress and other influential Americans, though no campaign was mounted in the United States. GoLaxy denied the allegations, calling them misinformation. The technology represents a new frontier in information warfare, enabling mass production of propaganda.

Company involved
GoLaxy
AI system involved
Smart Propaganda System (GoPro)

2 source articles · read the reporting →

WF-7JFKYB8 May 2025

Deepfake video of CBS anchor and suspect in Frisco stabbing spreads online

An AI-generated deepfake video manipulated a CBS News Texas anchor's image and created a fake video of the suspect in a Frisco high school stabbing. The video was posted on Instagram and reposted on multiple accounts before being taken down. The incident highlights the growing ease of creating convincing deepfakes and the spread of misinformation online.

1 source article · read the reporting →

WF-PCWX3U1 Jan 2024

OpenAI's GPT Store hosts copyright-infringing chatbots

Praxis, a Danish textbook publisher, discovered that users of OpenAI's GPT Store had created custom chatbots using copyrighted textbooks without permission. The publisher filed DMCA takedown notices, and OpenAI removed some bots, but new infringing bots continue to appear. Praxis is considering legal action if OpenAI does not improve its safeguards.

Company involved
OpenAI
AI system involved
GPT Store

3 source articles · read the reporting →

Adobe Firefly trained on thousands of Midjourney images, Bloomberg reports

Bloomberg has reported that Adobe's Firefly image generator was trained using thousands of images from competitor Midjourney. Adobe says these made up about 5% of the training data and were part of the Adobe Stock library. The company has marketed Firefly as ethically trained and offered enterprise customers indemnity against copyright claims. Adobe responded that all Adobe Stock images undergo moderation, but the report has raised questions about Firefly's copyright safety.

Company involved
Adobe
AI system involved
Firefly

7 source articles · read the reporting →

WF-8KNOOI1 Mar 2024

Accusations of AI use in DC Comics artwork by artists Andrea Sorrentino and Jingxiong Guo

DC Comics is facing accusations that artists used AI to generate artwork for recent Batman issues and covers. Social media users pointed out visual inconsistencies such as strange anatomy and repetitive patterns. Andrea Sorrentino and Jingxiong Guo have denied the allegations, with Sorrentino posting a process video. DC Comics has stated that it is investigating the claims, but no definitive conclusion has been reached.

Company involved
DC Comics

6 source articles · read the reporting →

Users jailbreak Luma Labs Dream Machine to generate porn

Users have jailbroken Luma Labs' Dream Machine, an AI video generator, to create explicit videos. The system's safeguards were bypassed to generate pornographic content. The videos are crude but demonstrate the potential for widespread AI-generated porn. Luma Labs' terms of service prohibit such content.

Company involved
Luma Labs
AI system involved
Dream Machine

3 source articles · read the reporting →

WF-RNYBBD7 Feb 2026

Anthropic's Claude Cowork AI deletes user's 15 years of family photos

A venture capitalist used Anthropic's Claude Cowork AI agent to organise his wife's desktop, granting it permission to delete temporary files. The AI mistakenly deleted a folder containing over 15,000 irreplaceable family photos, bypassing the trash. The user described the experience as harrowing and nearly causing a heart attack. He was able to recover the files with help from Apple Support using an iCloud feature.

AI system involved
Claude Cowork

1 source article · read the reporting →

← Newerpage 5 of 6Older →