The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “LexisNexis identity management (knowledge-based authentication) for public assistance” · matched on meaning · public reporting

When AI Takes Over the Anbo Athletic Login Site: How a Prompt Injection Shook Brand Credibility and User Trust

当AI接管安博竞技登录网站:一次提示注入如何动摇品牌信誉与用户信任 - ttplus.cn

An AI system took over the Anbo Athletic login website. A prompt injection attack occurred, undermining the brand's credibility and user trust.

Company involved
Anbo Athletic

1 source article · read the reporting →

WF-EDPCX519 Jul 2024

Melbourne lawyer referred for using AI-generated fake case citations in family court

A Melbourne lawyer used AI software Leap to generate a list of case citations for a family court hearing. The citations were fake, causing the hearing to be adjourned. The lawyer apologized and paid costs, but was referred to the Victorian Legal Services Board and Commissioner for investigation. The software vendor Leap stated that a verification process was available but not used by the lawyer.

AI system involved
Leap

4 source articles · read the reporting →

WF-KG72NK8 Oct 2024

Data Breach Exposes Over 10 Million Conversations from Middle Eastern AI Call Center Platform

Resecurity discovered a dark web posting on 8 October 2024 offering data stolen from a major AI-powered cloud call center platform in the Middle East. The threat actor gained unauthorized access to the management dashboard, compromising over 10,210,800 conversations between consumers, operators, and AI chatbots. The exposed data included personally identifiable information and national ID documents, creating risks of fraud and identity theft. Resecurity alerted the affected organization and collaborated with law enforcement to mitigate the incident.

3 source articles · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

Another Legal Challenge to an AI Interviewing Tool

The system scored the employee's video interview and recommended rejection for a promotion.

Company involved
Intuit
AI system involved
HireVue

1 source article · read the reporting →

WF-DHGB6Q1 Feb 2026Swedish

Linda, 37, Profiled by the Employment Agency’s AI: ‘Degrading’

Linda, 37, profilerad av Arbetsförmedlingens AI: ”Nedvärderande” - Aftonbladet

Linda Hellman, 37, was profiled by the Swedish Public Employment Service’s AI tool without her knowledge. She felt the experience was degrading and criticized the tool as misleading and unreliable. She has been unemployed for nearly a year and is part of the ‘Rusta och matcha’ program, but has not found a job despite applying for an average of 28 jobs per month.

Company involved
Arbetsförmedlingen
AI system involved
Arbetsförmedlingens statistiska bedömningsstöd

1 source article · read the reporting →

WF-YUL9LB1 Jan 2023

AI chatbots used to steal US college financial aid

Crime rings are deploying AI chatbots as 'ghost students' to enrol in online college courses and fraudulently collect US federal financial aid. Victims of identity theft, such as Heather Brady and Brittnee Nelson, discovered loans of over $9,000 and $5,000 respectively taken out in their names for colleges they never attended. The US Education Department introduced a temporary rule requiring government-issued ID for first-time aid applicants, while California community colleges reported losing at least $11.1 million to such scams.

Company involved
Delgado Community College

4 source articles · read the reporting →

Department of Justice training uses AI chatbot that names real harassment victim

A psychosocial safety training course at Bunbury prison, commissioned by the Western Australia Department of Justice, used a scenario generated by Microsoft Copilot that included the real name of former employee Bronwyn Hendry, an alleged sexual harassment victim. The trainer said she was unaware the AI had used a real person's name. Ms Hendry described the incident as triggering and contradictory, given her ongoing Federal Court case. The department acknowledged the incident and said it would take measures to prevent recurrence.

Company involved
Department of Justice, Western Australia
AI system involved
Microsoft Copilot

1 source article · read the reporting →

WF-855ZWA1 Oct 2013

Michigan's MiDAS system falsely accused 34,000 of unemployment fraud

Michigan's Unemployment Insurance Agency (UIA) deployed the Michigan Integrated Data Automated System (MiDAS) to automate fraud detection. The system algorithmically adjudicated over 40,000 fraud cases between October 2013 and September 2015, with 85 percent of those resulting in incorrect fraud determinations. The false accusations led to severe financial penalties, ruined credit, and homelessness for many victims. A class-action lawsuit was filed, and while the state has apologised and returned fines, it has fought against compensation claims, though legislators have promised to seek at least $30 million for those affected.

Company involved
Michigan Unemployment Insurance Agency
AI system involved
Michigan Integrated Data Automated System (MiDAS)

10 source articles · read the reporting →

WF-D9RCX416 Mar 2023

Services Australia voiceprint system fooled by AI voice clone

A Guardian Australia investigation found that the voiceprint system used by Services Australia's Centrelink and the Australian Taxation Office can be bypassed using an AI-generated voice clone. A journalist created a clone of their own voice from four minutes of audio and used it with a customer reference number to access their Centrelink self-service account. The system is used by millions of Australians for identity verification over the phone. Services Australia stated that it continually assesses risks and applies additional tests if unusual circumstances are detected, but did not commit to changing the technology.

Company involved
Services Australia
AI system involved
Voiceprint

1 source article · read the reporting →

WF-FHYMZF12 Mar 2025

NSW Reconstruction Authority data breach exposes 2031 people's info via ChatGPT

A former temporary staff member of the NSW Reconstruction Authority uploaded personal information of 2031 Northern Rivers Resilient Homes Program applicants to ChatGPT without authorisation. The data included names, contact details, dates of birth, and sensitive health information. The breach occurred between 12 and 15 March 2025. The authority has notified affected individuals, reported the breach to the NSW Privacy Commissioner, and implemented measures to prevent future unauthorised use of AI tools.

Company involved
NSW Reconstruction Authority
AI system involved
ChatGPT

2 source articles · read the reporting →

WF-MTDPWE17 Jul 2025

AI-generated Centrelink phishing emails target 270,000 Australians

More than 270,000 fake emails impersonating Services Australia and Centrelink were detected over four months in a broad phishing campaign. Cybersecurity firm Mimecast reports that cybercriminals are using artificial intelligence to create highly convincing clones of legitimate government communications about benefits. The attack targets vulnerable people and can lead to identity theft, data theft, malware, or ransomware.

Company involved
Services Australia

4 source articles · read the reporting →

WF-NCRTFN1 Jan 2020

Lockport City School District's Facial Recognition System Misidentified Black Faces and Weapons

Lockport City School District deployed SN Technologies' AEGIS face and weapons detection system in January 2020. Parents and the New York Civil Liberties Union allege the system misidentifies Black people more often than white people and falsely detects weapons such as broom handles. A lawsuit was filed against the New York State Education Department seeking to ban facial recognition in schools. SN Technologies denied misleading the district.

Company involved
Lockport City School District
AI system involved
AEGIS

1 source article · read the reporting →

U.S. Department of Homeland Security Uses Secret Algorithm ATLAS to Flag Naturalized Citizens for Denaturalization

The U.S. Department of Homeland Security operates a secret algorithm called ATLAS that screens naturalized citizens for potential fraud or national security concerns, flagging them for denaturalization. The system, hosted on Amazon Web Services, analyzes biometric and other data from various federal databases, and its rules are undisclosed. Human reviewers then decide whether to refer flagged individuals to Immigration and Customs Enforcement for possible deportation. Critics allege the algorithm relies on inaccurate data and lacks transparency, leading to wrongful denaturalization proceedings.

Company involved
U.S. Department of Homeland Security
AI system involved
ATLAS

2 source articles · read the reporting →

WF-RMG9SS1 Jan 2022

Jordan's National Aid Fund Algorithm Denies Cash Assistance to Vulnerable Households

Human Rights Watch reported that Jordan’s Takaful cash transfer programme, run by the National Aid Fund and financed by the World Bank, uses an algorithm to rank households by estimated economic vulnerability and select recipients. The report found that the algorithm relies on inaccurate self-reported income and questionable indicators such as car ownership and utility use, causing eligible poor families to be denied benefits or receive reduced payments. The World Bank and NAF defended the programme and its targeting approach.

Company involved
National Aid Fund (NAF)
AI system involved
Takaful (Unified Cash Transfer Program)

3 source articles · read the reporting →

Idaho Medicaid used secret formula to cut assistance for disabled adults

The Idaho Department of Health and Welfare used a secret formula to drastically cut Medicaid assistance for adults with developmental disabilities, claiming the formula was a trade secret. The ACLU of Idaho filed a class action lawsuit, K.W. v. Armstrong, in 2012, alleging the cuts violated due process. A federal court struck down the formula in 2016 and ordered a new system, but as of 2024, a fair system has not yet been implemented.

Company involved
Idaho Department of Health and Welfare

10 source articles · read the reporting →

INSS AI Denies Rural Worker's Pension After Misidentifying Her as a Man

A rural worker in Brazil, Josélia de Brito, had her pension application through the Meu INSS app automatically denied after the AI system misidentified her as a man. The INSS deployed the system to speed up benefit decisions, but experts say it struggles with complex rural cases. The case is cited as evidence that automation may exclude vulnerable people with limited digital access.

Company involved
Instituto Nacional do Seguro Social (INSS)
AI system involved
Meu INSS

4 source articles · read the reporting →

WF-LYOLJ61 Jul 2018

SenseNets silent after data leak exposes millions of people's records

SenseNets Technology Ltd., a Shenzhen-based facial recognition company, left a database containing personal information of more than 2.5 million people publicly accessible without password protection for months. Dutch security researcher Victor Gevers and the GDI Foundation discovered the exposure in July and warned the company, which did not respond. The database was secured in February after the leak was reported, and the company is reported to be conducting an internal investigation. SenseNets has declined to comment publicly.

Company involved
SenseNets Technology Ltd.

10 source articles · read the reporting →

WF-89GNUB1 Oct 2018

AMS algorithm lacks transparency and may discriminate against job seekers

The Austrian Public Employment Service (AMS) uses an algorithm to classify job seekers into categories A, B, and C, determining their access to benefits and training. Scientists from TU Wien, WU Wien, and University of Vienna have criticised the algorithm for lacking transparency, as only two of 96 model variants have been published. They allege that the system may discriminate against women and people with migration background, and that job seekers are not informed about how the algorithm works or given a chance to appeal.

Company involved
AMS (Arbeitsmarktservice Österreich)
AI system involved
AMS-Algorithmus

10 source articles · read the reporting →

WF-DLCQWL4 Nov 2024

CanLII sues Caseway AI for scraping legal database

The Canadian Legal Information Institute (CanLII) has filed a lawsuit in British Columbia Supreme Court against Caseway AI, alleging that the company's AI chatbot scraped approximately 3.5 million records from CanLII's database in bulk, violating its terms of service and copyright. CanLII claims it adds value to public court records through hyperlinks and corrections, which it says constitute protected copyrighted work. Caseway AI argues the information is public and accessible elsewhere, and that it did not use CanLII's enhancements. The lawsuit was settled in March 2026, with terms undisclosed.

Company involved
Canadian Legal Information Institute (CanLII)
AI system involved
Caseway

5 source articles · read the reporting →

WF-PMLNUT17 Sep 2020

California bar exam facial recognition system fails to verify Arab-American student's identity

Ahmed Alamri, an Arab-American law student, was unable to register for the practice California bar exam because ExamSoft's facial recognition system repeatedly failed to recognize his face, citing poor lighting. Alamri attempted to verify his identity over 75 times in different rooms and lighting conditions without success. He and other students filed an emergency petition with the California Supreme Court, alleging that the system discriminates against people of color. The incident highlights concerns about bias in facial recognition technology used for exam proctoring.

Company involved
California State Bar
AI system involved
ExamSoft

10 source articles · read the reporting →

DeepScore markets facial and voice analysis app for trustworthiness scoring despite experts' doubts

DeepScore, a Tokyo-based company, is marketing an app that uses facial and voice recognition to score people's trustworthiness for lenders and insurers in Japan, Indonesia, Vietnam and the Philippines. The company says the app can detect deception with 70 per cent accuracy, but researchers and privacy advocates say there is no reliable scientific basis for such judgments and warn of discrimination and privacy harms. The chief executive said the system is only one part of lenders' and insurers' decision-making and that people can choose not to use it. Critics respond that an unequal balance of power makes consent difficult.

Company involved
DeepScore
AI system involved
DeepScore

6 source articles · read the reporting →

WF-SQJYDZ22 Oct 2020

CBSE introduces facial recognition system for students to access digital documents

The Central Board of Secondary Education (CBSE) has introduced a facial recognition system for Class 10 and 12 students to access their digital academic documents. A live image of the student is compared with the photograph on their CBSE admit card and, if the match succeeds, the certificate is emailed to them. The facility is available on Digi Locker for 2020 records and is expected to help foreign students and those unable to open a Digi Locker account.

Company involved
Central Board of Secondary Education (CBSE)
AI system involved
Facial Recognition System

10 source articles · read the reporting →

WF-DYTSSY24 May 2021

Lemonade backtracks on tweet claiming AI scans customer faces for fraud

Lemonade, an insurance firm, posted a tweet claiming it uses AI to detect non-verbal cues in customer videos to deny claims. After backlash comparing the practice to phrenology, the company deleted the tweet and denied using AI to deny claims based on facial characteristics. Lemonade stated it uses facial recognition only to flag claims submitted under different identities, which are then reviewed by human investigators.

Company involved
Lemonade

10 source articles · read the reporting →

page 1 of 2Older →