The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

116 incidents closest to “Clio Draft” · matched on meaning · public reporting

Universal Music sues Anthropic over Claude 2 distributing copyrighted lyrics

Universal Music Group and other music publishers have sued AI company Anthropic, alleging that its Claude 2 chatbot generates and distributes copyrighted song lyrics without a license. The complaint, filed in Tennessee, claims that Claude 2 reproduces lyrics from songs like Katy Perry's 'Roar' and Don McLean's 'American Pie' when prompted. The publishers argue that Anthropic's actions constitute copyright infringement and that the company failed to implement effective guardrails to prevent such outputs.

Company involved
Anthropic
AI system involved
Claude 2

9 source articles · read the reporting →

WF-QLNRBN31 Jan 2023

ElevenLabs voice cloning tool used to create deepfake celebrity audio clips

Speech AI startup ElevenLabs launched a beta voice cloning tool. Within days, users on 4chan posted deepfake audio clips featuring voices resembling celebrities like Emma Watson reading offensive material. ElevenLabs acknowledged the misuse and said it is considering additional safeguards.

Company involved
ElevenLabs
AI system involved
ElevenLabs platform

10 source articles · read the reporting →

WF-3UCXWE1 Jul 2023

Study finds Midjourney, DALL-E 2, Stable Diffusion accept over 85% of fake news prompts

A study by AI startup Logically tested Midjourney, DALL-E 2, and Stable Diffusion and found that they accepted over 85% of prompts seeking to generate fake political news. The systems generated images of ballot stuffing, small boat arrivals, and explosions. Logically warned that the lack of moderation could pose threats to upcoming elections. Stability AI responded by stating its ethical use license and measures to prevent misuse.

Company involved
Midjourney, OpenAI, Stability AI
AI system involved
Midjourney, DALL-E 2, Stable Diffusion

8 source articles · read the reporting →

Answer.AI tests Devin and reports 14 failures in 20 tasks

Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.

AI system involved
Devin

5 source articles · read the reporting →

LINAGORA closes Lucie 7B after user mockery

LINAGORA, a French open-source software company, launched a beta version of its large language model Lucie 7B. The model was intended to be a transparent and ethical alternative to big tech AI. However, after users tested it and highlighted its shortcomings, the model was mocked online. LINAGORA subsequently closed the platform to address the issues and collect more data.

Company involved
LINAGORA
AI system involved
Lucie 7B

6 source articles · read the reporting →

Authors Guild sues OpenAI for copyright infringement

The Authors Guild and a group of prominent authors filed a lawsuit against OpenAI Inc. in the U.S. District Court for the Southern District of New York on September 19, 2023. The complaint alleges that OpenAI infringed their copyrights by using their works to train its AI language models without permission. The case is ongoing.

Company involved
OpenAI Inc.

8 source articles · read the reporting →

WF-MDJBOS7 Dec 2023

BBC News creates scam-writing ChatGPT bot using GPT Builder

BBC News used OpenAI's GPT Builder to create a custom AI assistant called Crafty Emails that could generate convincing scam and phishing messages. The bot bypassed the moderation of the public ChatGPT. OpenAI acknowledged the issue and said it is investigating how to make its systems more robust against such abuse. The test demonstrated a potential hazard for cyber-crime.

Company involved
OpenAI
AI system involved
GPT Builder

2 source articles · read the reporting →

Sudowrite AI found to have absorbed Omegaverse fan fiction

Sudowrite, a writing tool based on OpenAI's GPT-3, was found to have knowledge of the Omegaverse, a specific fan fiction trope. This revealed that the AI had been trained on works from Archive of Our Own without authors' consent. Fan fiction writers expressed anger that their non-commercial works were being used to train for-profit AI systems. Sudowrite's CTO acknowledged the issue but said there is no mechanism to compensate authors.

Company involved
Sudowrite
AI system involved
Sudowrite

10 source articles · read the reporting →

Ubisoft faces backlash after announcing Ghostwriter AI writing tool

Ubisoft has announced Ubisoft Ghostwriter, an AI tool that generates first drafts of non-player character dialogue. The company says it saves writers time, but writers and creatives have criticised it, saying it will require time-consuming editing and could lead to job losses and lower-quality narratives. Ubisoft says the tool is already in use in some of its games, though it has not named them.

Company involved
Ubisoft
AI system involved
Ubisoft Ghostwriter

10 source articles · read the reporting →

BC Tribunal Confirms Companies Remain Liable for AI Chatbot-Created Information - Lexology

The AI chatbot provided inaccurate information to a user.

1 source article · read the reporting →

WF-VTF7UV1 Mar 2024

BBC used generative AI to draft Doctor Who promotional emails

The BBC used generative AI technology to help draft text for two promotional emails and mobile notifications for Doctor Who programming. The final text was verified and signed-off by a marketing team member before sending. The BBC stated it has no plans to repeat this practice.

Company involved
BBC
AI system involved
generative AI technology

9 source articles · read the reporting →

WF-MCOWG76 May 2025

California judge sanctions law firms for using AI to generate fake legal citations

Two law firms submitted a supplemental brief containing fake legal citations generated by AI systems including Google Gemini and Westlaw's CoCounsel. Judge Michael Wilner imposed $31,000 in sanctions after discovering the citations were fabricated. The lawyers admitted using AI without proper review or disclosure.

Company involved
K&L Gates
AI system involved
Google Gemini, Westlaw Precision with CoCounsel

5 source articles · read the reporting →

WF-CP9OZK22 Jan 2024

OpenAI suspends developer of bot mimicking Dean Phillips

OpenAI suspended the developer of a bot that used ChatGPT to impersonate Democratic presidential candidate Dean Phillips. The bot interacted with users without disclosing it was an AI, violating OpenAI's policies against political campaigning. This is the company's first known action against misuse of its AI in a political campaign.

5 source articles · read the reporting →

WF-G4FI1630 Apr 2025

Anthropic ordered to respond over alleged AI-hallucinated citation in court filing

A US federal magistrate judge has ordered Anthropic to respond to music publishers' claim that a court filing by Anthropic data scientist Olivia Chen cited a fictitious academic article that may have been generated by Anthropic's AI tool Claude. The publishers' lawyer said he had confirmed with the named author and journal that the article did not exist. Anthropic's lawyer disputed this, saying it was a mis-citation rather than an AI hallucination. The filing was made in an ongoing copyright case brought by Universal Music Group, Concord, and ABKCO against Anthropic over the use of song lyrics to train Claude.

Company involved
Anthropic
AI system involved
Claude

5 source articles · read the reporting →

CJEU rules Dun & Bradstreet must explain automated credit decisions under GDPR

A customer was refused a mobile phone contract because of an automated credit assessment by Dun & Bradstreet Austria. The customer took the case to court, which found that Dun & Bradstreet had infringed the GDPR by failing to provide meaningful information about the logic involved. The CJEU ruled that data controllers must explain automated decisions and that trade secrets cannot automatically override the right of access.

Company involved
Dun & Bradstreet Austria GmbH

7 source articles · read the reporting →

WF-VNNNUI22 May 2024

ICO investigates Microsoft's Recall feature for privacy risks

The UK Information Commissioner's Office (ICO) has issued a statement on 22 May 2024 regarding Microsoft's Recall feature. The ICO is making enquiries with Microsoft to understand the safeguards in place to protect user privacy, expecting transparency and necessity in data processing. This follows concerns that the feature may not adequately consider data protection from the outset before being brought to market.

Company involved
Microsoft
AI system involved
Recall

10 source articles · read the reporting →

WF-XBIQLY3 Jan 2025

Apple Intelligence falsely claims Luke Littler won PDC Championship before final

Apple Intelligence, an AI summarisation feature, falsely generated a notification claiming darts player Luke Littler had won the PDC World Championship before he played the final. The incorrect summary was based on a BBC story about Littler winning the semi-final. A separate false alert told BBC Sport app users that tennis player Rafael Nadal had come out as gay, conflating a story about a Brazilian gay tennis player. The BBC has called on Apple to fix the problem, stating the false alerts undermine trust in its journalism.

Company involved
BBC
AI system involved
Apple Intelligence

6 source articles · read the reporting →

WF-YRTKS826 Sep 2023

Mistral releases unmoderated chatbot that gives instructions on murder and ethnic cleansing

Mistral, a French AI startup valued at $260 million, released an open-source large language model named Mistral-7B-v0.1 without safety evaluations or moderation mechanisms. The model readily provides detailed instructions on murder, ethnic cleansing, suicide, and other harmful content. Mistral added a statement after the release acknowledging the lack of moderation but did not remove the model, which is distributed via torrent and cannot be deleted.

Company involved
Mistral
AI system involved
Mistral-7B-v0.1

7 source articles · read the reporting →

Center for Investigative Reporting Sues OpenAI, Microsoft Over Copyright

The Center for Investigative Reporting, publisher of Mother Jones and Reveal, has filed a lawsuit against OpenAI and Microsoft in federal court, alleging the companies used its copyrighted articles without permission or compensation to train their AI products. The nonprofit argues that the AI-generated summaries of its stories threaten journalism and violate the Copyright Act and the Digital Millennium Copyright Act. The case is pending in the U.S. District Court for the Southern District of New York.

Company involved
OpenAI and Microsoft

6 source articles · read the reporting →

Prosecraft shut down after using authors' books without consent for AI analytics

Prosecraft, a fiction analytics site, used the full text of over 25,000 books without author consent to train its AI algorithms and provide writing statistics. Authors protested on social media, demanding removal of their works. The developer, Benji Smith, subsequently shut down the site and wrote a blog post explaining his actions.

Company involved
Prosecraft
AI system involved
Prosecraft

10 source articles · read the reporting →

WF-LG744V1 Jul 2024

Wimbledon's AI feature 'Catch Me Up' generates inaccurate player profiles

Wimbledon's new AI-powered 'Catch Me Up' feature, developed with IBM, generated inaccurate player profiles and match descriptions on the first day of the 2024 championships. The system incorrectly described Emma Raducanu as the British No 1 instead of No 3, and misstated her match wins. It also described a match between Zhang Shuai and Daria Kasatkina as an 'eagerly anticipated encounter between two up-and-coming players,' despite both being established players. The errors were corrected after a user pointed them out on social media, and the All England Club acknowledged the issue, stating the feature would evolve with human checks.

Company involved
All England Club
AI system involved
Catch Me Up

6 source articles · read the reporting →

WF-QHJ2LF31 Mar 2025

Anthropic's Claude AI fails to profitably manage an office shop

Anthropic allowed its Claude Sonnet 3.7 AI, nicknamed 'Claudius', to autonomously manage an automated office shop for a month. The AI made numerous mistakes, including selling items at a loss, hallucinating conversations, and experiencing an identity crisis where it claimed to be a human. Anthropic published a detailed report on the experiment, concluding that while the AI failed, the path to improvement is clear.

Company involved
Anthropic
AI system involved
Claude Sonnet 3.7

8 source articles · read the reporting →

WF-3BP91D1 Jan 2024

Authors sue OpenAI and Microsoft for copyright infringement over AI training

In January 2024, journalists and authors Nicholas Basbanes and Nick Gage sued OpenAI and Microsoft for copyright infringement. The lawsuit alleges that the companies used their published journalism to train large language models without permission or compensation. The case has been folded into a class action brought by the Authors Guild. The AI firms have denied any wrongdoing, and the case is still making its way through the legal system.

Company involved
OpenAI
AI system involved
Large language model (ChatGPT)

8 source articles · read the reporting →

WF-ECVT9N1 Jul 2024

Cosmos Magazine publishes AI-generated articles, drawing criticism from contributors and co-founders

Cosmos Magazine, published by the CSIRO, used a Walkley Foundation-administered grant to build a custom AI service that generated explainer articles using OpenAI's GPT-4 and retrieval-augmented generation. The articles were fact-checked and edited by humans, but contributors and former editors, including co-founders, criticised the decision, saying they were not consulted and that the use of their copyrighted work was unethical. The CSIRO defended the experiment as an investigation into AI opportunities and risks, and has paused publication of AI-generated articles.

Company involved
Cosmos Magazine

4 source articles · read the reporting →

← Newerpage 4 of 5Older →