The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

152 incidents closest to “Canvas Studio” · matched on meaning · public reporting

WF-OVARPI11 May 2023

Bloomsbury uses AI-generated image on book cover, sparking controversy

Twitter users noticed that the cover of Sarah J. Maas's 'House of Earth and Blood', published by Bloomsbury, features an AI-generated image from Adobe Stock. The publisher is accused of using AI to avoid paying a human illustrator. Bloomsbury has not yet responded to the controversy.

Company involved
Bloomsbury

9 source articles · read the reporting →

Adobe accused of selling unlabelled AI-generated Israel–Palestine images on Adobe Stock

Adobe has been accused of selling AI-generated images of the Israel–Palestine conflict on Adobe Stock without clearly labelling them as synthetic. The photorealistic images, produced with tools such as Firefly, could be mistaken for authentic photography and fuel misinformation. An investigation by Interesting Engineering found many images that appeared to be AI-generated but were not labelled as such. Adobe's published policy says Stock accepts AI-generated content if it meets submission standards.

Company involved
Adobe
AI system involved
Adobe Firefly

7 source articles · read the reporting →

WF-JO4IRG3 Dec 2022

Lensa AI app generated nudes from user's childhood photos

Lensa, a photo-editing AI app, generated sexualized and nude images from users' uploaded photos, including childhood photos of writer Olivia Snow. Snow alleges the app violated its own terms by producing full nudity and child sexual exploitation material, and that it whitened and sexualised women of colour's images. The app's lack of content moderation and oversight allowed these harmful outputs, with no response from the company.

Company involved
Lensa
AI system involved
Lensa

9 source articles · read the reporting →

WF-4RZUE65 Dec 2023

Civitai dropped by cloud provider OctoML over CSAM image generation

Civitai, an AI image generation platform, was dropped by its cloud computing provider OctoML after an investigation by 404 Media found it was being used to generate images that could be categorized as child sexual abuse material (CSAM). The platform also faced scrutiny for nonconsensual deepfakes of celebrities and private citizens, primarily women. Civitai added new moderation filters in response, but OctoML terminated the business relationship.

Company involved
Civitai
AI system involved
Civitai

8 source articles · read the reporting →

WF-TC706S24 Apr 2024

Walmart accused of selling AI-generated artwork with spelling errors

Walmart has been accused of selling AI-generated artwork in its stores. A painting of a fake Chanel perfume bottle with the misspelled word 'CHANE' was spotted on a shelf. The artwork, originally priced at $26.54 and marked down to $22.15, was supplied by Design Art. The incident raises concerns about the use of AI in retail products without disclosure.

Company involved
Walmart

3 source articles · read the reporting →

Jailbreak bypasses safety guardrails on ChatGPT, Claude, Gemini

Security researchers at HiddenLayer discovered a prompt injection technique called the Policy Puppetry Attack that can bypass safety guardrails on major AI models including ChatGPT, Claude, and Gemini. The jailbreak combines policy file code and leetspeak to trick models into producing harmful outputs such as instructions for enriching uranium or self-harm. The researchers argue that this indicates a major flaw in how LLMs are trained and aligned.

AI system involved
ChatGPT, Claude 3.7, Gemini 2.5

5 source articles · read the reporting →

WF-KN420W1 Jun 2024

Runway accused of training Gen-3 on scraped YouTube videos and pirated films

Runway, the AI company behind the Gen-3 video generator, is accused of training its model on thousands of YouTube videos and pirated films without permission, according to a leaked internal spreadsheet obtained by 404 Media. The spreadsheet lists thousands of YouTube channels belonging to major media companies and popular creators. A former employee said the company used proxies to scrape videos from YouTube. After being contacted by 404 Media, Runway stopped generating videos that named specific YouTubers, but did not respond to requests for comment.

Company involved
Runway
AI system involved
Gen-3

5 source articles · read the reporting →

WF-8HC83K6 Nov 2020

Deepfake video falsely shows PornHub banner on CNN's Magic Wall

A viral video appeared to show a PornHub banner pop up on CNN's Magic Wall behind anchor John King. The video was actually a deepfake, created by editing a real CNN clip. The article from Mediaite debunks the video, showing it was faked. The creator of the deepfake is unknown.

10 source articles · read the reporting →

← Newerpage 7 of 7