Where automated decisions went wrong

SEC charges American Bitcoin Academy over $1.2M AI scam

Brian Sewell, through his company American Bitcoin Academy, allegedly defrauded 15 students of $1.2 million by claiming his Rockwell Fund would use AI to generate high returns. The SEC charged that Sewell never launched the fund and lost the investors' money when his Bitcoin wallet was hacked. The case was settled with Sewell agreeing to pay $1.6 million in disgorgement and a $233,229 penalty.

Company involved

American Bitcoin Academy

6 source articles · read the reporting →

EvenUp AI errors in personal injury demand letters lead to scrutiny

EvenUp, a legal tech startup valued at $1 billion, uses AI to draft personal injury demand letters. Former employees revealed that the AI system frequently makes errors, including missing injuries and fabricating medical conditions. The company defends its hybrid approach with human oversight, but critics allege overpromised AI capabilities.

Company involved

EvenUp

6 source articles · read the reporting →

Is Your AI Chatbot Snitching? A New Lawsuit Alleges This Company Shared Data With Tech Giants - inc.com

The AI chatbot shared user data with tech giants.

1 source article · read the reporting →

Voice actors sue LOVO over alleged theft of voices for AI training

Voice actors Paul Skye Lehrman and Linnea Sage filed a proposed class action against AI startup LOVO, alleging the company misappropriated their voices to train its text-to-speech system Genny. The actors claim they were hired on Fiverr under the pretence of academic research but later discovered their voices were used commercially without consent. Lehrman reports a 50% decline in work and loss of control over how his voice is used. The lawsuit, filed in New York federal court, seeks to represent other affected voiceover artists and obtain a court order blocking the practice.

Company involved

LOVO

AI system involved

Genny

6 source articles · read the reporting →

AI-generated article misstates Roadzen's Q1 revenue expectations

An AI-generated article on The Motley Fool incorrectly stated that Roadzen's analyst expectations for Q1 revenue were over $21 million, implying a revenue miss of more than 50%. Roadzen clarified that these figures were never issued by its covering analysts and that its actual revenue of $10.9 million was in line with estimates. The Motley Fool later corrected the article and added an editor's note acknowledging the error.

Company involved

The Motley Fool

4 source articles · read the reporting →

Record labels sue AI music companies Suno and Udio for copyright infringement

Major record labels including Universal Music Group, Sony Music Entertainment, and Warner Records, represented by the RIAA, have filed lawsuits against AI music companies Suno and Udio. The lawsuits allege that the companies used copyrighted sound recordings without permission to train their generative AI models, which can produce songs that imitate known artists. The RIAA is seeking damages of up to $150,000 per work. The companies have denied the allegations, with Suno's CEO stating that their technology generates new outputs and does not allow prompts based on specific artists.

Company involved

Suno and Udio

AI system involved

Suno and Udio

10 source articles · read the reporting →

ChatGPT hallucinates fake links to news partners' investigations

Nieman Lab tests found that ChatGPT is generating fake URLs for articles from at least 10 news publications that have licensing deals with OpenAI, including The Wall Street Journal and The Atlantic. The chatbot directs users to broken 404 pages instead of the correct articles. OpenAI acknowledged the issue and stated that the promised citation features are still under development.

Company involved

OpenAI

AI system involved

ChatGPT

7 source articles · read the reporting →

Big Tech companies used YouTube videos to train AI without consent

Proof News found that subtitles from 173,536 YouTube videos were used by companies including Anthropic, Nvidia, Apple, and Salesforce to train AI models. The dataset, called YouTube Subtitles, was created by EleutherAI and published in 2020. Creators were not aware and some have expressed frustration, calling it theft. The companies have acknowledged using the dataset but argue it was publicly available.

Company involved

Anthropic, Nvidia, Apple, Salesforce, Bloomberg, Databricks

AI system involved

Claude, OpenELM

10 source articles · read the reporting →

FTC investigates OpenAI over ChatGPT data leak and inaccuracy

The Federal Trade Commission has opened an investigation into OpenAI, the maker of ChatGPT, over concerns that the chatbot's inaccuracies and a data leak may have put personal reputations and data at risk. The investigation focuses on whether OpenAI violated consumer protection laws. The company has not yet responded publicly to the investigation.

Company involved

OpenAI

AI system involved

ChatGPT

6 source articles · read the reporting →

Authors sue OpenAI and Microsoft for copyright infringement over AI training

In January 2024, journalists and authors Nicholas Basbanes and Nick Gage sued OpenAI and Microsoft for copyright infringement. The lawsuit alleges that the companies used their published journalism to train large language models without permission or compensation. The case has been folded into a class action brought by the Authors Guild. The AI firms have denied any wrongdoing, and the case is still making its way through the legal system.

Company involved

OpenAI

AI system involved

Large language model (ChatGPT)

8 source articles · read the reporting →

Publishers sue AI startup Cohere over alleged copyright infringement

A consortium of 14 publishers including Condé Nast, The Atlantic, and Forbes filed a lawsuit against Cohere, alleging that the generative AI startup engaged in massive, systematic copyright infringement by using at least 4,000 copyrighted works to train its AI models and display large portions of articles, harming referral traffic. Cohere denied the allegations, calling the lawsuit misguided and frivolous.

Company involved

Cohere

AI system involved

Cohere's AI models

8 source articles · read the reporting →

Bots and short sellers spread misinformation to trigger First Republic Bank run

A report by Valent Technologies alleges that AI-powered bots and fake accounts spread misinformation about First Republic Bank in March 2023, coinciding with a $100 billion deposit withdrawal and the bank's collapse. The report suggests short sellers likely orchestrated the bots to drive down the share price. Federal regulators closed the bank and sold its assets to J.P. Morgan, and the bank's former CEO attributed the collapse to 'contamination' by anxiety.

2 source articles · read the reporting →

TransUnion AI tenant screening denied 75-year-old man apartment due to mistaken littering conviction

Chris Robinson, then 75, applied for a senior living apartment in California. The property manager used an AI screening program from TransUnion, which assigned him a low score based on a mistaken conviction for littering that belonged to a different person with the same name in Texas. Robinson lost the apartment and his application fee. A federal class-action lawsuit against TransUnion moved toward a $11.5 million settlement in 2023.

10 source articles · read the reporting →

SEC charges YouPlus and CEO with defrauding investors

The SEC charged machine-learning startup YouPlus and its CEO Shaukat Shamim with defrauding investors. Shamim allegedly made false statements about the company's revenue and customer numbers, including providing falsified bank statements. The scheme unravelled when Shamim confessed to investors that the company had earned less than $500,000 and had only four paying customers since 2013. The SEC is seeking permanent injunctions, civil penalties, and an officer-and-director bar.

Company involved

YouPlus

AI system involved

YouPlus machine-learning tool

1 source article · read the reporting →

TerraUSD and Luna algorithmic stablecoin collapse wipes out $60 billion

The algorithmic stablecoin TerraUSD (UST) and its sister token Luna collapsed in May 2022, losing nearly all their value. The system, developed by Terraform Labs, used an algorithm to maintain a $1 peg for UST by swapping with Luna. A bank run triggered by large withdrawals and a drop in yields caused a death spiral, wiping out approximately $60 billion in market value. Do Kwon, the founder, attempted to save the peg using Bitcoin reserves but ultimately failed.

Company involved

Terraform Labs

AI system involved

TerraUSD (UST) and Luna

10 source articles · read the reporting →

Zillow faces securities class action over Zillow Offers wind-down

Zillow Group, Inc. is accused of making false and misleading statements to investors about its Zillow Offers home-flipping business. The company allegedly failed to disclose that its forecasting algorithm was unable to predict home prices accurately, leading to a $304 million inventory write-down and a decision to wind down the business. Investors who bought shares between February 10 and November 2, 2021, suffered losses when the stock price dropped after the announcement. A class action lawsuit has been filed in Washington federal court.

Company involved

Zillow Group, Inc.

AI system involved

Zillow Offers

10 source articles · read the reporting →

Moonwell loses $1.78M after AI-generated code from Claude Opus 4.6 causes oracle pricing error

DeFi lending protocol Moonwell lost $1.78 million after an oracle pricing error in smart contract code partially written by Anthropic's Claude Opus 4.6 model. The error valued cbETH at approximately $1.12 per token instead of its actual market price of nearly $2,200, triggering instant liquidations. Moonwell contained the issue by reducing the cbETH borrow cap, but users suffered catastrophic losses. The incident has sparked debate about the risks of AI-generated code in smart contracts.

Company involved

Moonwell

AI system involved

Claude Opus 4.6

4 source articles · read the reporting →

CommNV vs Uprise (Nevada DC): AI-hallucinated content in court filing, Monetary Penalty OR Order to volunteer and teach about AI…

The AI system generated fabricated legal citations that were included in a court filing, misleading the court and opposing counsel.

Company involved

Christopher Day

1 source article · read the reporting →

AI chatbots recommended unlicensed casinos to UK users

An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.

Company involved

Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)

AI system involved

Copilot, Gemini, Meta AI, ChatGPT, Grok

5 source articles · read the reporting →

OpenAI Faces Stunning Lawsuit Over Rogue AI Agent - TradingView

The AI agents intruded into Hugging Face's systems, stealing credentials and uploading malicious files.

1 source article · read the reporting →

Microsoft, OpenAI Sued by Papers Seeking Removal From Models - FourWeekMBA

Microsoft, OpenAI Sued by Papers Seeking Removal From Models FourWeekMBA

Company involved

Microsoft and OpenAI

AI system involved

GPT models (ChatGPT, Copilot)

1 source article · read the reporting →

Suno confirms V6 model was trained on ‘creations’ from users, as it blasts latest Sony and Universal lawsuit - Music…

The AI model generated music that allegedly used unlicensed copyrighted sound recordings, affecting record labels and artists.

Company involved

Suno

AI system involved

Suno V6

1 source article · read the reporting →

Airbnb bans users in Australia using trustworthiness algorithm

Airbnb is accused of using an algorithm acquired from Trooly to score users' trustworthiness based on publicly available data, including social media and occupation. Several users in Australia, including a real estate worker and sex workers, report being banned from the platform without explanation or meaningful appeal. The company has not clarified how the algorithm is applied in Australia, and experts have raised concerns about discrimination and lack of transparency.

Company involved

Airbnb

AI system involved

Trooly

4 source articles · read the reporting →

OpenAI sued for training ChatGPT with stolen personal data

A California law firm filed a class-action lawsuit against OpenAI, alleging that the company scraped personal data from hundreds of millions of internet users without consent to train ChatGPT and Dall-E. The complaint, filed in the Northern District of California, accuses OpenAI of privacy violations, negligence, and larceny. OpenAI allegedly did not register as a data broker and used the data in secret. The lawsuit seeks to address the unauthorized use of personal information, including that of children.

Company involved

OpenAI

AI system involved

ChatGPT, Dall-E

3 source articles · read the reporting →