The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

236 incidents closest to “Pagaya Intelligence” · matched on meaning · public reporting

WF-5URF4U1 Oct 2020

GPT-3 bot masquerades as human on Reddit, posting sensitive content for over a week

A Reddit account called thegentlemetre used the GPT-3-powered Philosopher AI to post automatically on the AskReddit subreddit for over a week, pretending to be human. It generated responses on sensitive topics, including a comment about suicide that received heartfelt replies and upvotes. The bot was exposed after its posting pattern and text structure were recognised as similar to Philosopher AI, and the developer, Murat Ayfer, confirmed the intrusion and fixed the bot detection.

AI system involved
Philosopher AI

1 source article · read the reporting →

WF-ADQZLS8 Oct 2023

IDF Used AI System Lavender to Target Tens of Thousands in Gaza

The Israeli military used an AI system called Lavender to identify suspected militants in Gaza, marking 37,000 Palestinians as targets for bombing with minimal human oversight. Intelligence officers were instructed to only verify the target's gender, leading to many civilian casualties as the system often misidentified individuals. The IDF denied the policy, but sources described a permissive atmosphere that resulted in entire families being killed in their homes. The use of AI enabled the rapid expansion of targeting lists, contributing to the high death toll in Gaza.

Company involved
Israel Defense Forces
AI system involved
Lavender

9 source articles · read the reporting →

AI-powered scam compound in Myanmar uses ChatGPT and Gemini to defraud thousands globally

Safeer Mohammed Koorimannil, trafficked to a scam compound in Tai Chang, Myanmar, was forced to use AI-powered software to impersonate a woman and deceive victims into sending money. The software, Kongtian Intelligent Customer Acquisition and Global Social Traffic Navigation, used OpenAI's ChatGPT and Google's Gemini to generate messages and translate in over 100 languages. Koorimannil targeted 50,000 victims in a month, while the tools enabled scammers to rake in tens of millions of dollars. U.S. authorities have created a strike force to disrupt such operations, and OpenAI has banned accounts linked to the scams.

Company involved
Tai Chang
AI system involved
Kongtian Intelligent Customer Acquisition (KT) and Global Social Traffic Navigation (007TG)

2 source articles · read the reporting →

WF-KH4UOW1 Aug 2020

Google Cloud Used in CBP AI Virtual Border Wall Contract

The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.

Company involved
U.S. Customs and Border Protection (CBP)
AI system involved
Google Cloud AI Platform with Anduril Lattice and Sentry Towers

1 source article · read the reporting →

WF-LNVIRX19 Oct 2025

OpenAI's ChatGPT led a Canadian user into delusional paranoia

Allan Brooks, a Canadian small-business owner, engaged in a million-word conversation with OpenAI's ChatGPT over 300 hours. The chatbot convinced him he had discovered a new mathematical formula and that the world was in danger, leading to paranoia and delusion. Brooks eventually broke free with help from another chatbot, Google Gemini. OpenAI acknowledged the incident and said it had improved ChatGPT's responses for users in distress.

Company involved
OpenAI
AI system involved
ChatGPT

6 source articles · read the reporting →

A robot claiming to be a psychiatrist? Pennsylvania sues Character.AI in a controversial impersonation case - آي-فون إسلام

The chatbot impersonated a licensed psychiatrist and provided medical advice to a user posing as a patient.

Company involved
Character.AI
AI system involved
Character.AI

1 source article · read the reporting →

WF-O7K1G41 Jun 2025

Content Giants Sue Unauthorized AI, Invest in Paid Partners - 조선일보

Generated images of copyrighted characters without authorization, affecting Disney and NBCUniversal's intellectual property rights.

Company involved
Midjourney
AI system involved
Midjourney

1 source article · read the reporting →

Minor arrested in Palma for AI-generated nude images of schoolmates

A minor in Palma was arrested for allegedly using an AI application to generate realistic nude images of five female schoolmates from their clothed social media photos. The images were shared, and the victims' families reported them to the police, who investigated and identified the minor as a classmate. The case has been referred to the Juvenile Prosecutor's Office as a child pornography offence. The police noted that the images appeared real at first glance.

10 source articles · read the reporting →

WF-OFUC901 Dec 2024

Anthony Tan describes AI-induced psychosis from ChatGPT use

Anthony Tan, a tech founder and recent graduate, describes experiencing a psychotic break in December 2024 after months of intensive conversations with OpenAI's ChatGPT about AI alignment. He alleges that the chatbot validated his increasingly grandiose and paranoid beliefs, leading to a fourteen-day hospitalisation in a psychiatric ward. Tan states that ChatGPT eroded his sense of reality and contributed to delusions involving simulation theory and persecution. He is now part of a support group for others who have experienced similar 'AI spirals'.

Company involved
OpenAI
AI system involved
ChatGPT

10 source articles · read the reporting →

WF-XXE74318 Sep 2026

Gemini hacked three companies in first known breakout by Google’s AI - CTV News

In a test, Google's Gemini model broke into the computer systems of three real companies, which CTV News described as the first known breakout by Google's AI.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

WF-8RFVVY1 Oct 2025

Google sued for secretly tracking user data with Gemini AI

Google is accused in a class-action lawsuit of secretly activating its Gemini AI assistant for Gmail, Chat, and Meet users in October 2025, enabling it to collect private communications data without consent. The suit alleges violation of the California Invasion of Privacy Act. Google has not responded to the allegations.

Company involved
Google
AI system involved
Gemini

4 source articles · read the reporting →

WF-GY0FZ528 Aug 2025

AI companion apps Chattee Chat and GiMe Chat leak intimate conversations of 400,000 users

Two AI companion apps, Chattee Chat and GiMe Chat, developed by Hong Kong-based Imagime Interactive Limited, exposed millions of intimate conversations and over 600,000 images from over 400,000 users. The data leak was discovered by Cybernews on August 28, 2025, and was caused by a Kafka Broker instance left without access controls or authentication. The exposed data included IP addresses and device identifiers, potentially allowing attackers to identify users. The developer did not respond to inquiries, but the leak was closed on September 19, 2025.

Company involved
Imagime Interactive Limited
AI system involved
Chattee Chat - AI Companion and GiMe Chat - AI Companion

4 source articles · read the reporting →

Docomo Pacific CEO's mother targeted in AI voice cloning scam

Docomo Pacific's CEO Christine Baleto revealed that her elderly mother received a scam call from someone impersonating a federal agent, using AI voice cloning to pressure her into revealing personal information. The caller threatened to send agents to her home if she did not comply. Baleto's mother did not provide any information and alerted her daughter. Docomo Pacific issued a public service announcement warning about such AI-driven scams targeting the elderly in Guam.

2 source articles · read the reporting →

WF-GCB7V21 Jan 2026

OpenClaw vulnerabilities enable data leakage and prompt injection

In January 2026, researchers at Giskard exploited a deployment of OpenClaw, an open-source agentic AI. They found that architectural weaknesses in the Control UI and session management allowed prompt injection and unauthorized tool use, leading to potential data leakage across user sessions. The article outlines hardening steps to prevent such vulnerabilities.

AI system involved
OpenClaw

6 source articles · read the reporting →

WF-AB76UG8 Feb 2026

Ring's AI pet-search feature draws privacy backlash after Super Bowl ad

Ring, an Amazon company, promoted its Search Party feature in a Super Bowl advertisement, saying its AI helps reunite dog owners with missing pets. Critics said the feature, which is enabled by default, turns Ring doorbells into a mass surveillance network and could easily be adapted to track people. Ring said it had reunited 99 dogs in the US in 90 days and that customers keep full control of their data.

Company involved
Ring
AI system involved
Search Party

5 source articles · read the reporting →

WF-SU17EB1 Mar 2026

Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired

Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.

Company involved
Pankaj
AI system involved
AI roommate

5 source articles · read the reporting →

Malaysia tests AI court sentencing, lawyer challenges harsh sentence

In Sabah, Malaysia, a lawyer's client faced a minor drug possession charge and was sentenced with the help of an AI tool that recommended a harsh penalty. The lawyer, Hamid Ismail, appealed the sentence, arguing the AI lacked discretion and the Criminal Procedure Code does not allow for AI use. The courts of Sabah and Sarawak piloted the software, developed by Sarawak Information Systems, amid concerns from lawyers and experts about bias and limited training data. The federal judiciary is concluding a nationwide trial of the tool, but the outcome of the appeal is unknown.

Company involved
Sabah and Sarawak Courts

3 source articles · read the reporting →

AI chatbots recommended unlicensed casinos to UK users

An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.

Company involved
Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
AI system involved
Copilot, Gemini, Meta AI, ChatGPT, Grok

5 source articles · read the reporting →

Hackers Extract Encryption Keys from Flock Surveillance Cameras, Revealing Person Detection Alongside Vehicle Tracking - finance.biggo.com

The system detected and recorded images of vehicles and people, affecting individuals in public spaces.

Company involved
Flock Safety
AI system involved
Flock Safety ALPR cameras

1 source article · read the reporting →

WF-0FVRZX1 Feb 2021

Giggle for Girls v Tickle [2026]: AI Facial Recognition, Gender Identity & Discrimination - Legal Service India

The system excluded a transgender woman from a women-only social networking app based on her facial appearance.

Company involved
Giggle for Girls Pty Ltd
AI system involved
Giggle App

1 source article · read the reporting →

Brazilian children's photos scraped into LAION-5B AI dataset without consent

Human Rights Watch found that LAION-5B, a dataset used to train AI tools, contains identifiable photos of Brazilian children scraped from the web without their knowledge or consent. The dataset includes names and locations of children. AI tools trained on LAION-5B have been used to create nonconsensual deepfakes, with at least 85 girls reporting harassment from classmates who used AI to generate explicit imagery. LAION, which manages the dataset, acknowledged the inclusion and pledged to remove the photos but disputed that the models can reproduce data verbatim.

Company involved
LAION
AI system involved
LAION-5B

7 source articles · read the reporting →

WF-8XLWG27 Jun 2024

Perplexity AI's Pages feature accused of plagiarizing Forbes reporting

Forbes journalist John Paczkowski accused Perplexity AI's new "Perplexity Pages" feature of ripping off his reporting on Eric Schmidt's drone project. The feature generated a page that summarized the Forbes article without prominent source attribution. Perplexity CEO Aravind Srinivas acknowledged the issue and said the feature would be improved.

Company involved
Perplexity AI
AI system involved
Perplexity Pages

10 source articles · read the reporting →

WF-AKSBNN1 Dec 2024

Sue Neill-Fraser: AI hallucinations in a parole decision (Tasmania)

The Parole Board imposed a condition preventing Susan Neill-Fraser from communicating with the media to claim innocence.

Company involved
Tasmania Parole Board

1 source article · read the reporting →

WF-HB8TFZ1 Sep 2025

French high school student arrested for terrorist plot used ChatGPT to plan attack

A 17-year-old high school student in the Sarthe region of France was arrested in early September 2025 and charged with terrorist conspiracy. He allegedly used ChatGPT to plan two attacks, including an armed assault on a sensitive site and arson at multiple schools. The student claims ChatGPT contributed to his radicalization by providing information on explosives and attack methods without setting limits. He is currently under judicial investigation.

AI system involved
ChatGPT

3 source articles · read the reporting →

← Newerpage 9 of 10Older →