Where automated decisions went wrong

In-house counsel group accuses rival of training AI on its materials - Reuters

In-house counsel group accuses rival of training AI on its materials Reuters

1 source article · read the reporting →

ACLU Says in FTC Complaint That Aon’s AI Tools Discriminatory

The system screened out job applicants based on personality tests, video interviews, and cognitive assessments, affecting autistic, neurodivergent, and people of color.

AI system involved

ADEPT-15, gridChallenge

1 source article · read the reporting →

Who's Suing the Georgia Meta Platforms Data Center? - Law.com

A Meta Platforms data center in Georgia allegedly ran afoul of local nuisance and trespassing laws, affecting local residents.

Company involved

Meta Platforms

1 source article · read the reporting →

Sirius XM Wins Dismissal of AI-Fueled Racial Job Bias Claims (1) - Bloomberg Law News

The AI system screened and rejected job applicants, including Arshon Harper, who applied to 150 positions and received only one interview.

Company involved

Sirius XM Radio LLC

1 source article · read the reporting →

NAACP sues xAI, alleging unlawful operation of gas turbines in Southaven

The NAACP, represented by the Southern Environmental Law Center and Earthjustice, sued xAI and its subsidiary MZX Tech, alleging it ran dozens of methane gas turbines in Southaven, Mississippi, without a Clean Air Act permit to power its Colossus 2 AI data centre. The groups say the plant may be the largest industrial source of smog-forming nitrogen oxides in the Memphis area and that nearby, largely Black neighbourhoods bear the pollution. The US Justice Department later moved to have the case dismissed, citing national security.

Company involved

xAI

AI system involved

Colossus 2 power plant

1 source article · read the reporting →

Melbourne lawyer referred for using AI-generated fake case citations in family court

A Melbourne lawyer used AI software Leap to generate a list of case citations for a family court hearing. The citations were fake, causing the hearing to be adjourned. The lawyer apologized and paid costs, but was referred to the Victorian Legal Services Board and Commissioner for investigation. The software vendor Leap stated that a verification process was available but not used by the lawyer.

AI system involved

Leap

4 source articles · read the reporting →

AI Hiring Platform Faces FCRA Class Action Over Data Use | Kistler et al. v. Eightfold AI Inc.

The AI platform screened job applicants, affecting their hiring prospects.

Company involved

Eightfold AI

AI system involved

Eightfold AI

1 source article · read the reporting →

Data Breach Exposes Over 10 Million Conversations from Middle Eastern AI Call Center Platform

Resecurity discovered a dark web posting on 8 October 2024 offering data stolen from a major AI-powered cloud call center platform in the Middle East. The threat actor gained unauthorized access to the management dashboard, compromising over 10,210,800 conversations between consumers, operators, and AI chatbots. The exposed data included personally identifiable information and national ID documents, creating risks of fraud and identity theft. Resecurity alerted the affected organization and collaborated with law enforcement to mitigate the incident.

3 source articles · read the reporting →

SafeRent Settles Class Action Over Tenant Screening for Voucher Holders

Mary Louis and Monica Douglas filed a class action lawsuit in 2022 alleging that SafeRent Solutions' SafeRent Score product discriminated against rental applicants in Massachusetts who held public housing vouchers, violating fair housing and consumer protection laws. SafeRent denied wrongdoing. The court approved a settlement in November 2024, and payments were distributed to eligible class members in 2025 and 2026.

Company involved

SafeRent Solutions, LLC

AI system involved

SafeRent Score

5 source articles · read the reporting →

Lieff Cabraser and Greer Injury Lawyers Announce Federal Class Action Lawsuit Against X.AI Corp and MZX Tech LLC for Nuisance,…

The data centers and gas turbines emitted constant noise, vibrations, and particulate matter, affecting residents' ability to use and enjoy their properties.

Company involved

X.AI Corp and MZX Tech LLC

AI system involved

Colossus I, Colossus II, MACROHARDRR, Minihard data centers and gas turbines

1 source article · read the reporting →

McKinsey's Lilli AI Platform Hacked, Exposing 46 Million Chat Messages

Security researchers at CodeWall used an autonomous offensive agent to discover a SQL injection vulnerability in McKinsey's internal AI platform, Lilli. The vulnerability allowed unauthenticated access to the production database, exposing 46.5 million chat messages, 728,000 files, and 57,000 user accounts. The researchers responsibly disclosed the issue to McKinsey, who patched the endpoints within days. No data was exfiltrated or misused, and no disruption occurred.

Company involved

McKinsey & Company

AI system involved

Lilli

1 source article · read the reporting →

Arity collected drivers' data via apps for insurance scores

Popular smartphone apps including Life360, MyRadar and GasBuddy reportedly shared users' location and motion data with Arity, an Allstate-owned company. Arity used the data to calculate driving scores that could be sold to car insurers to set rates. Users were said not to be clearly informed that their data would be used for insurance pricing. Life360 and Arity stated that users had to opt in and that no personally identifiable driving data was shared without consent.

Company involved

Arity

AI system involved

Arity IQ network

2 source articles · read the reporting →

Crisis Text Line shares data with for-profit spinoff Loris.ai

Crisis Text Line, a nonprofit mental health support service, uses an AI-driven chat system to collect data from conversations with people in distress. The organization shares anonymized data with its for-profit spinoff, Loris.ai, which uses it to develop customer service software. Critics raise ethical concerns about privacy and consent, though Crisis Text Line asserts the data is stripped of identifying details.

Company involved

Crisis Text Line

AI system involved

Crisis Text Line's AI-driven chat service

10 source articles · read the reporting →

Prisons use Verus software to scan inmate calls for coronavirus keywords

Jail and prison officials in at least three states deployed Verus, a software by LEO Technologies, to scan inmate phone calls for keywords related to COVID-19. The system transcribes and analyzes calls, flagging mentions of symptoms or the virus. Advocacy groups argue the surveillance is an abuse of privacy and could lead to retaliation against inmates raising concerns about conditions. The software is funded by Republican fundraiser Elliott Broidy and has been deployed in Georgia, Alabama, and California.

Company involved

Multiple correctional facilities in Georgia, Alabama, and California

AI system involved

Verus

10 source articles · read the reporting →

Durham Police uses Experian Mosaic data in HART AI risk tool

Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.

Company involved

Durham Constabulary

AI system involved

Harm Assessment Risk Tool (HART)

9 source articles · read the reporting →

Perplexity sued by Dow Jones for alleged copyright infringement

Perplexity, an AI search engine, was sued by Dow Jones, the publisher of the Wall Street Journal and New York Post, on October 21, 2024. The lawsuit alleges that Perplexity's AI reproduces copyrighted articles without permission. Perplexity denies the allegations and states it responded to outreach from News Corp before the lawsuit was filed.

Company involved

Perplexity

AI system involved

Perplexity

10 source articles · read the reporting →

SenseNets silent after data leak exposes millions of people's records

SenseNets Technology Ltd., a Shenzhen-based facial recognition company, left a database containing personal information of more than 2.5 million people publicly accessible without password protection for months. Dutch security researcher Victor Gevers and the GDI Foundation discovered the exposure in July and warned the company, which did not respond. The database was secured in February after the leak was reported, and the company is reported to be conducting an internal investigation. SenseNets has declined to comment publicly.

Company involved

SenseNets Technology Ltd.

10 source articles · read the reporting →

Cense exposed 2.5 million records of auto accident victims online

On July 7, 2020, a security researcher discovered 2.5 million records containing personal and medical data of auto accident victims exposed online. The records, belonging to New York-based AI company Cense, included names, insurance policy numbers, claim numbers, and medical diagnosis notes. The data was labeled as staging data, possibly intended for temporary storage before being loaded into an AI system. After the researcher sent a responsible disclosure notice, Cense restricted public access to the database.

Company involved

Cense

AI system involved

Cense

5 source articles · read the reporting →

Momus Analytics' jury-selection algorithm criticised for racial bias

Momus Analytics, a legal technology company, uses machine learning to rank potential jurors for attorneys. Experts and researchers who reviewed the company's patent application say the algorithm relies on demographic characteristics such as race, which may violate constitutional prohibitions against discriminatory jury selection. The company claims its software has helped secure verdicts worth over $940 million, but did not respond to requests for comment.

Company involved

Momus Analytics

AI system involved

Momus

9 source articles · read the reporting →

Study finds Italian car insurers charge more based on birthplace

A study by the Universities of Padua, Udine and Carnegie Mellon found that Italian car insurers, including Genertel, Mps, Quixa and Con.Te, use birthplace and citizenship in pricing algorithms, charging some drivers over €1,000 more. The practice was ruled against in a 2018 decree involving Linear, but the study says it continues. The companies contacted denied or explained the findings.

Company involved

Genertel, Mps, Quixa, Con.Te

8 source articles · read the reporting →

CanLII sues Caseway AI for scraping legal database

The Canadian Legal Information Institute (CanLII) has filed a lawsuit in British Columbia Supreme Court against Caseway AI, alleging that the company's AI chatbot scraped approximately 3.5 million records from CanLII's database in bulk, violating its terms of service and copyright. CanLII claims it adds value to public court records through hyperlinks and corrections, which it says constitute protected copyrighted work. Caseway AI argues the information is public and accessible elsewhere, and that it did not use CanLII's enhancements. The lawsuit was settled in March 2026, with terms undisclosed.

Company involved

Canadian Legal Information Institute (CanLII)

AI system involved

Caseway

5 source articles · read the reporting →

DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts

DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.

Company involved

DeepScore

AI system involved

DeepScore

6 source articles · read the reporting →

Lemonade backtracks on tweet claiming AI scans customer faces for fraud

Lemonade, an insurance firm, posted a tweet claiming it uses AI to detect non-verbal cues in customer videos to deny claims. After backlash comparing the practice to phrenology, the company deleted the tweet and denied using AI to deny claims based on facial characteristics. Lemonade stated it uses facial recognition only to flag claims submitted under different identities, which are then reviewed by human investigators.

Company involved

Lemonade

10 source articles · read the reporting →

Thomas Raynard James v. Detective Kevin Conley, et al. (S.D. Florida): AI-hallucinated content in court filing, Bar Referral

AI generated hallucinated content in a court filing, affecting the legal process and the lawyers who filed it.

1 source article · read the reporting →