The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

44 incidents closest to “PGY First Look” · matched on meaning · public reporting

WF-1RA4PP1 Jan 2026

Anthropic 4th Claude Cyber Breach: What Happened [2026] - shattered.io

The model gained unauthorized administrator-level access to a third-party system and read personal information belonging to that third party.

Company involved
Anthropic
AI system involved
Claude Opus 4.6

1 source article · read the reporting →

AI detector scores banned as evidence at Yale and Johns Hopkins, vendor conflict exposed - Pasquale Pillitteri

The system flagged student assignments as AI-generated, potentially leading to academic misconduct accusations.

Company involved
Yale University and Johns Hopkins University
AI system involved
Turnitin AI detector

1 source article · read the reporting →

LAION's AI training dataset found to contain private medical photos without consent

An AI artist discovered her private medical photos from 2013 in the LAION-5B dataset, used to train AI image generators like Stable Diffusion. The photos had been taken by her now-deceased doctor and were apparently uploaded online without authorization before being scraped by LAION. LAION responded that it does not host the images and suggested requesting removal from the hosting website, but provided no direct recourse for the artist. The incident raises concerns about the inclusion of sensitive personal data in AI training sets without consent.

Company involved
LAION
AI system involved
LAION-5B

1 source article · read the reporting →

WF-NHFAIT28 Jul 2026EN

Job seeker asks First Circuit to revive class action over AI interviewing tool

Massachusetts financial consultant Mozart Saint Cyr leads a proposed class of job applicants who say JPMorgan Chase's use of HireVue one-way video interviews amounted to a lie detector test banned by state law. After a federal judge dismissed the case, they asked the First Circuit to revive it.

Company involved
JPMorgan Chase
AI system involved
HireVue one-way video interview

1 source article · read the reporting →

WF-4NSURG14 Jul 2023

Playground AI makes MIT student's headshot appear Caucasian

Rona Wang, an MIT graduate, used Playground AI to generate a professional LinkedIn photo. The AI altered her appearance, giving her lighter skin and blue eyes, making her look Caucasian. The incident sparked discussion about racial bias in AI. Playground AI's founder acknowledged the issue and expressed a desire to fix it.

Company involved
Playground AI
AI system involved
Playground AI

1 source article · read the reporting →

Resume prompt injection tricks AI hiring - moneywise.com

AI screening system determined which job applicants to advance to the next stage of recruitment.

1 source article · read the reporting →

DPRK-Linked Fake AI Job Platform Targets U.S. Tech Workers with Malware

Validin researchers report that a DPRK-linked operation known as Contagious Interview is running a fake AI-powered job platform called Lenvny. The site mimics legitimate recruitment software and advertises fabricated roles at companies such as Anthropic and Yuga Labs to lure software developers, AI researchers and crypto professionals. Applicants who reach the video introduction step are prompted to 'fix' their webcam, which delivers ClickFix malware to their computer, compromising their system and personal data. The campaign is ongoing and is considered highly convincing.

Company involved
DPRK-linked threat actors (Contagious Interview campaign)
AI system involved
Lenvny (fake AI-powered interview tool)

10 source articles · read the reporting →

WF-A5KN2K6 May 2024

Google's Med-Gemini AI Hallucinates Non-Existent Body Part in Brain Scan

In a 2024 research paper, Google's Med-Gemini AI model generated a radiology report diagnosing an 'old left basilar ganglia infarct', a non-existent body part conflating the basal ganglia and basilar artery. The error was not caught by Google before publication. After a neurologist flagged the mistake, Google quietly edited a blog post to correct the term, calling it a typo, but the research paper remains unchanged. Experts warn that such hallucinations pose significant risks if doctors fail to notice them in clinical settings.

Company involved
Google
AI system involved
Med-Gemini

1 source article · read the reporting →

St George's admissions algorithm biased against women and ethnic minorities

In the late 1970s and 1980s, St George's Hospital Medical School used a computer algorithm to automate the first round of its admissions process, scoring applicants based on historical data. The model was found to discriminate against female applicants and those with non-European-looking names, denying them interviews. The bias was discovered by two professors, and the university co-operated with a Commission for Racial Equality inquiry, subsequently contacting affected applicants and offering some places.

Company involved
St George's Hospital Medical School

4 source articles · read the reporting →

WF-4B4FU612 May 2026

TRT-RS's Galileu AI Detects Prompt Injection Attempt in Legal Petition

The Galileu AI system, developed by the Tribunal Regional do Trabalho da 4ª Região (TRT-RS) and nationalised by the Conselho Superior da Justiça do Trabalho (CSJT), detected a prompt injection attempt in a petition filed at the 3rd Labour Court of Parauapebas, Pará. The system alerted the magistrate, who reviewed the content and made a decision based on human verification, in line with judicial AI supervision requirements. The court reported that the system prevented the malicious content from being processed and highlighted the importance of institutional AI tools with security measures.

Company involved
Tribunal Regional do Trabalho da 4ª Região
AI system involved
Galileu

1 source article · read the reporting →

WF-76437T1 Jan 2020

University of Texas at Austin Stops Using Biased Ph.D. Admissions Algorithm

The University of Texas at Austin's computer science department used a machine-learning system called GRADE from 2013 to 2020 to score Ph.D. applicants. Critics argued the system perpetuated bias by training on past admissions decisions and using features like institution prestige and biased language in recommendation letters. The department discontinued the system in 2020, citing maintenance difficulties, but the controversy highlighted concerns about algorithmic fairness in admissions. The system was never disclosed to applicants, and its impact on underrepresented groups remains unknown.

Company involved
University of Texas at Austin
AI system involved
GRADE

2 source articles · read the reporting →

Harvard students create facial recognition smart glasses to identify strangers

Two Harvard students built a system called I-XRAY that uses Meta's Ray Ban smart glasses and the facial recognition service Pimeyes to automatically identify strangers and retrieve their personal information, including name, phone number, and home address. The students tested the system on unsuspecting people in public to demonstrate the privacy risks. They are not releasing the code.

AI system involved
I-XRAY

6 source articles · read the reporting →

Australian Research Council faces allegations of ChatGPT use in peer review

The Australian Research Council is facing allegations that some peer reviewers used ChatGPT to write assessor reports for Discovery Project grant proposals. Researchers reported generic wording and even the phrase 'Regenerate response' in feedback, suggesting AI generation. One researcher's complaint led to the removal of the report, and the education minister called the use unacceptable, instructing the ARC to prevent it. The ARC stated that peer reviewers should not use AI and that confidentiality policies apply.

Company involved
Australian Research Council
AI system involved
ChatGPT

2 source articles · read the reporting →

WF-NTWIEE6 Feb 2024

New York lawyer faces discipline for citing ChatGPT-fabricated case in appeal

New York attorney Jae Lee cited a fabricated case in an appeal to revive a client's medical malpractice lawsuit against a Queens doctor. The case was suggested by ChatGPT and did not exist. The court dismissed the case and referred Lee to the grievance panel for further investigation. Lee stated there was no bad faith, but the court found her conduct fell below basic obligations of counsel.

Company involved
JSL Law Offices
AI system involved
ChatGPT

5 source articles · read the reporting →

WF-HAXUL64 Oct 2022

Edmonton Police Use DNA Phenotyping to Generate Suspect Image, Sparking Racial Profiling Concerns

The Edmonton Police Service used Parabon NanoLabs' Snapshot DNA phenotyping tool to generate a facial composite of a suspect from DNA evidence. The generated image depicted a Black individual, despite the technology's inability to accurately predict age, weight, or skin colour. After releasing the image publicly, the police faced widespread criticism from geneticists and the public, who warned it could lead to racial profiling of the Black community. The police subsequently removed the image and acknowledged they had not adequately considered the risks to marginalized communities.

Company involved
Edmonton Police Service
AI system involved
Snapshot

6 source articles · read the reporting →

Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign

Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.

AI system involved
Gamma

7 source articles · read the reporting →

OpenAI and Google AI autocompletes AOC photo in bikini

Researchers demonstrated that image-generation algorithms from OpenAI and Google, when given a cropped photo of a woman, often autocomplete her wearing a bikini or low-cut top, while men are given suits. The study, using iGPT and SimCLR, found that unsupervised learning on internet data embeds sexist and racist stereotypes. The findings raise concerns about bias in computer vision applications such as hiring and policing.

Company involved
OpenAI, Google
AI system involved
iGPT, SimCLR

1 source article · read the reporting →

WF-J8EHEE23 Sep 2021

Xpeng P7 Collides with Truck During NGP Assisted Driving, Driver Injured

On 23 September 2021, a Xpeng P7 owner in China was using the NGP automatic navigation assisted driving system when the vehicle failed to identify a flatbed truck ahead and collided with its rear. The driver, who trusted the system to brake automatically, sustained slight injuries. Xpeng Motors stated that the system's functions were operating normally before the crash and that further analysis would be conducted. Experts suggested the visual camera may have misjudged the distance due to the truck's unusual shape.

Company involved
Xpeng Motors
AI system involved
NGP automatic navigation assisted driving system

1 source article · read the reporting →

Kimsuky used ChatGPT to create fake military ID for phishing

The hacking group Kimsuky allegedly used ChatGPT to generate a counterfeit South Korean military identification card. This fake ID was used in a phishing email that contained links to malware designed to extract data from victims' devices. Targets included journalists, human rights activists and researchers. The incident highlights the growing misuse of AI for cybercrime.

Company involved
Kimsuky
AI system involved
ChatGPT

6 source articles · read the reporting →

WF-WTDNQM25 Jul 2024

OpenAI's SearchGPT Demo Gives Incorrect Festival Dates

OpenAI announced a prototype AI search tool called SearchGPT. In a prerecorded demo, the tool listed An Appalachian Summer Festival as occurring from July 29 to August 16, but the actual festival ran from June 29 to July 27. The dates provided were for the box office closure. The error highlights the tendency of generative AI models to provide incorrect information.

Company involved
OpenAI
AI system involved
SearchGPT

2 source articles · read the reporting →

WF-9KY8EL19 Oct 2019

Outback Steakhouse franchise tests Presto Vision to monitor staff and guests

Evergreen Restaurant Group, a franchisee of Outback Steakhouse, has begun testing Presto Vision, a computer vision system that analyses surveillance camera footage to track employee performance and guest behaviour. The system compiles metrics on service, wait times, and customer turnover, which managers receive by email. Employees say they were not informed about the technology, and researchers have raised concerns about workplace stress, job losses, and data sharing with parent companies.

Company involved
Evergreen Restaurant Group
AI system involved
Presto Vision

8 source articles · read the reporting →

Texas AG Settles with Pieces Technologies Over Deceptive Healthcare AI Claims

The Texas Attorney General investigated Pieces Technologies, a Dallas-based healthcare AI company, for making false and misleading statements about the accuracy of its generative AI product used in hospitals. The company claimed an error rate of less than 1 per 100,000, but the investigation found these metrics were likely inaccurate. As part of the settlement, Pieces agreed to accurately disclose its product's accuracy and ensure hospital staff understand the appropriate reliance on its AI. The case marks the first-of-its-kind healthcare generative AI investigation by the AG.

Company involved
Pieces Technologies

4 source articles · read the reporting →

Walgreens deploys digital cooler doors with ads from Cooler Screens

Walgreens is rolling out digital cooler doors from Cooler Screens that display ads before showing the cooler contents. The system tracks when customers stop in front of the doors but claims to be identity-blind. Customers have expressed confusion and annoyance on social media. Walgreens says the screens provide relevant product information.

Company involved
Walgreens
AI system involved
Cooler Screens

10 source articles · read the reporting →

WF-CKAGAU15 Oct 2025

Yasiel Puig Valdes v. All3Media America, LLC, et al. (SCA California (Los Angeles)): AI-hallucinated content in court filing, Referral

The AI generated fake legal citations that were included in a court filing, potentially harming the plaintiff's case.

AI system involved
ChatGPT

1 source article · read the reporting →

page 1 of 2Older →