The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

330 incidents closest to “Mark43 CAD” · matched on meaning · public reporting

WF-91RMGY1 May 2023

Two men in Japan charged for selling AI-generated anime posters

Two men in Japan, a 36-year-old office worker from Yokohama and a 40-year-old self-employed resident of Hikone, are accused of using generative AI to create and sell posters of characters from Evangelion, Yu-Gi-Oh, and other anime series. The posters were sold via an online auction site between 2023 and 2024, earning the Yokohama man roughly 10 million yen and the Hikone man 5.7 million yen. Both men have admitted to the accusations and face charges of copyright violation.

Company involved
Not applicable (individuals, not an organisation)

4 source articles · read the reporting →

Adobe accused of selling unlabelled AI-generated Israel–Palestine images on Adobe Stock

Adobe has been accused of selling AI-generated images of the Israel–Palestine conflict on Adobe Stock without clearly labelling them as synthetic. The photorealistic images, produced with tools such as Firefly, could be mistaken for authentic photography and fuel misinformation. An investigation by Interesting Engineering found many images that appeared to be AI-generated but were not labelled as such. Adobe's published policy says Stock accepts AI-generated content if it meets submission standards.

Company involved
Adobe
AI system involved
Adobe Firefly

7 source articles · read the reporting →

WF-V7YVGR1 Jan 2021

North Carolina psychiatrist sentenced for using AI to create child pornography

David Tatum, a North Carolina child psychiatrist, was sentenced to 40 years in prison for using artificial intelligence to modify innocent images of minors into child pornography. He also secretly recorded minors undressing. Tatum was convicted of production, transportation, and possession of child pornography. The FBI stated the crimes were 'inconceivable' for a doctor entrusted with children's mental health.

9 source articles · read the reporting →

Adoption algorithm Family-Match produced limited results in multiple states

The AI-powered adoption algorithm Family-Match, developed by Adoption-Share and designed by former eharmony researchers, has produced limited results in states where it was used. Social workers reported that the tool often matched children with unwilling families and failed to generate successful adoptions. Virginia, Georgia, and Tennessee dropped or paused the algorithm after trials, though some later resumed use. The algorithm's creator, Thea Ramirez, disputed the accounts and said the tool is a starting point for social workers.

Company involved
Adoption-Share
AI system involved
Family-Match

7 source articles · read the reporting →

Prisma Labs wins arbitration in Lensa biometric privacy lawsuit

Artificial intelligence company Prisma Labs is accused of violating Illinois' biometric privacy law by collecting facial geometry data from users of its Lensa app. A proposed class action was filed, but a California federal judge granted Prisma's motion to compel arbitration because users agreed to it during sign-up. The plaintiff alleges the app collected his facial data without consent.

Company involved
Prisma Labs Inc.
AI system involved
Lensa AI

8 source articles · read the reporting →

WF-4RZUE65 Dec 2023

Civitai dropped by cloud provider OctoML over CSAM image generation

Civitai, an AI image generation platform, was dropped by its cloud computing provider OctoML after an investigation by 404 Media found it was being used to generate images that could be categorized as child sexual abuse material (CSAM). The platform also faced scrutiny for nonconsensual deepfakes of celebrities and private citizens, primarily women. Civitai added new moderation filters in response, but OctoML terminated the business relationship.

Company involved
Civitai
AI system involved
Civitai

8 source articles · read the reporting →

WF-W2CRPI23 Dec 2023

Midjourney v6 accused of generating near-identical copyrighted images

Midjourney's v6 image generator has been criticized for producing images that closely resemble copyrighted movie scenes, such as a Joaquin Phoenix Joker scene. Artist Reid Southen accused the company of using copyrighted content without a license and said his account was banned. Midjourney has updated its terms of service to hold users responsible for intentional copyright infringement. The company faces multiple lawsuits over training data.

Company involved
Midjourney
AI system involved
Midjourney v6

7 source articles · read the reporting →

WF-CXWXFH1 Feb 2024

Disney engineer's life destroyed after downloading malware disguised as AI tool

Matthew Van Andel, a 42-year-old former Disney engineer, downloaded a free AI image generation tool from GitHub in February 2024. The software was actually malware that gave hackers access to his personal and work data, including Disney's internal messages. Hackers stole his financial information and published over 44 million Disney messages online. Van Andel was subsequently fired by Disney after a forensic analysis found pornography on his work computer, which he denies. He lost approximately $200,000 in bonuses and his health insurance, and his family's online accounts were also compromised.

Company involved
Disney

7 source articles · read the reporting →

WF-FYQD0T1 Jan 2023

UK Ministry of Justice secretly develops murder prediction system

The UK Ministry of Justice is developing the Homicide Prediction Project, a system that uses police and government data to profile hundreds of thousands of people, including suspects, victims, and vulnerable individuals, to predict who will commit murder. The project, a collaboration with the Home Office, Greater Manchester Police, and the Metropolitan Police, uses sensitive personal data such as mental health and addiction records. Concerns have been raised that the system will reinforce structural discrimination against racialised and low-income communities.

Company involved
Ministry of Justice
AI system involved
Homicide Prediction Project

6 source articles · read the reporting →

Zoox issues voluntary software recall after robotaxi collision in Las Vegas

Zoox voluntarily recalled its robotaxi software after an unoccupied autonomous vehicle collided with a passenger vehicle in Las Vegas. The robotaxi misjudged the other car's intention, braking hard but making contact unavoidable. No injuries were reported and damage was minor. Zoox issued a software update and filed a report with NHTSA.

Company involved
Zoox
AI system involved
Zoox robotaxi

7 source articles · read the reporting →

Jailbreak bypasses safety guardrails on ChatGPT, Claude, Gemini

Security researchers at HiddenLayer discovered a prompt injection technique called the Policy Puppetry Attack that can bypass safety guardrails on major AI models including ChatGPT, Claude, and Gemini. The jailbreak combines policy file code and leetspeak to trick models into producing harmful outputs such as instructions for enriching uranium or self-harm. The researchers argue that this indicates a major flaw in how LLMs are trained and aligned.

AI system involved
ChatGPT, Claude 3.7, Gemini 2.5

5 source articles · read the reporting →

SEC Investigating Evolv Over AI Weapons Detection System

The U.S. Securities and Exchange Commission is investigating Evolv Technology, the maker of an AI-based weapons detection system used in schools and other venues. The system has been accused of producing false positives and exhibiting racial bias. A lawsuit from a school district has also been filed against the company.

Company involved
Evolv Technology
AI system involved
Evolv AI weapons detection system

5 source articles · read the reporting →

WF-XV5P501 Oct 2015

Amazon Buy Box algorithm accused of overcharging UK consumers by £1 billion

Consumer champion Robert Hammond has filed a collective proceedings order application against Amazon in the UK Competition Appeal Tribunal. The claim alleges that Amazon's Buy Box algorithm manipulated search results to favour products more profitable for Amazon, obscuring cheaper alternatives and causing approximately 49.4 million UK consumers to overpay by more than £1 billion between October 2015 and June 2020. The algorithm determined the first-ranked item in the Buy Box, which consumers accepted over 80% of the time. The case is pending, and similar investigations by the Italian Competition Authority and the UK Competition and Markets Authority are ongoing.

Company involved
Amazon
AI system involved
Buy Box algorithm

5 source articles · read the reporting →

WF-KN420W1 Jun 2024

Runway accused of training Gen-3 on scraped YouTube videos and pirated films

Runway, the AI company behind the Gen-3 video generator, is accused of training its model on thousands of YouTube videos and pirated films without permission, according to a leaked internal spreadsheet obtained by 404 Media. The spreadsheet lists thousands of YouTube channels belonging to major media companies and popular creators. A former employee said the company used proxies to scrape videos from YouTube. After being contacted by 404 Media, Runway stopped generating videos that named specific YouTubers, but did not respond to requests for comment.

Company involved
Runway
AI system involved
Gen-3

5 source articles · read the reporting →

Patagonia Targeted by Privacy Class Action for Use of Customer Service AI Software - Law.com

The system intercepted, recorded, and mined data from customer service calls, affecting customers' privacy.

Company involved
Patagonia
AI system involved
Talkdesk

1 source article · read the reporting →

MAJOR LAWSUIT ALERT!: Home Depot And Google Facing CIPA Lawsuit For Use Of Google’s Cloud Contact Center AI - natlawreview.com

The system recorded and transcribed customer service calls without consent, affecting the privacy of callers.

Company involved
Home Depot
AI system involved
Google Cloud Contact Center AI

1 source article · read the reporting →

WF-2FOHB414 Aug 2021

St. Louis County Facial Recognition Lawsuit: Gatlin Wrongful Arrest - hoodline.com

The system identified Christopher Gatlin as a suspect in an assault, leading to his arrest and 17-month incarceration.

Company involved
St. Louis County and City of St. Louis
AI system involved
St. Louis Mugshot Recognition Technology System

1 source article · read the reporting →

Talkdesk Hit With Class Suit Over Customer Service Software - news.bloomberglaw.com

The system secretly recorded and analyzed customer service conversations of callers to Patagonia and Zumiez without consent.

Company involved
Talkdesk Inc.
AI system involved
CX Cloud

1 source article · read the reporting →

← Newerpage 14 of 14