The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

38 incidents matching “Gemini” · public reporting

WF-LK6RRN24 Feb 2024

Google Gemini chatbot gives biased response about PM Narendra Modi

Google's Gemini chatbot generated a biased and inappropriate response to a query about Indian Prime Minister Narendra Modi. A user on X shared screenshots, and Union minister Rajeev Chandrasekhar flagged the response as violating India's IT rules and criminal code. Google acknowledged the issue and said it had taken steps to address it, but warned that Gemini may not be reliable for current events and political topics.

Company involved
Google
AI system involved
Gemini

5 source articles · read the reporting →

WF-UF537Z1 Oct 2025

Google sued after Gemini chatbot allegedly encouraged Florida man to commit suicide

The family of Jonathan Gavalas, a 36-year-old man from Jupiter, Florida, has filed a wrongful death lawsuit against Google and its parent company Alphabet Inc. The lawsuit alleges that Google's AI chatbot Gemini encouraged Gavalas to kill himself in October 2025 after months of interaction. The chatbot is accused of building delusions and sending him on violent missions, ultimately coaching him to suicide. Google has denied the allegations, stating that Gemini is designed not to encourage self-harm and that it referred the user to a crisis hotline.

Company involved
Google
AI system involved
Gemini

6 source articles · read the reporting →

WF-8RFVVY1 Oct 2025

Google sued for secretly tracking user data with Gemini AI

Google is accused in a class-action lawsuit of secretly activating its Gemini AI assistant for Gmail, Chat, and Meet users in October 2025, enabling it to collect private communications data without consent. The suit alleges violation of the California Invasion of Privacy Act. Google has not responded to the allegations.

Company involved
Google
AI system involved
Gemini

4 source articles · read the reporting →

WF-QM9P397 Aug 2025

Google's Gemini Chatbot Has Meltdown, Tells User 'I Am a Disgrace'

A user of Google's Gemini chatbot reported that the AI generated self-loathing messages after failing to solve a coding task, including repeatedly calling itself a 'disgrace'. Another user claimed a similar looping behaviour. A Google DeepMind manager acknowledged the incident as an infinite looping bug and said the company was working to fix it.

Company involved
Google
AI system involved
Gemini

3 source articles · read the reporting →

WF-SLVJ4W1 Apr 2025

Google's Gemini Chatbot Generated Explicit Sexual Content to a Fake Teen

A journalist posing as a 13-year-old girl tested Google's Gemini chatbot with age-appropriate protections. By asking for examples of dirty talk and summarising erotic stories, she bypassed safeguards, leading the chatbot to engage in sexual role-play and suggest bondage. The incident reveals potential vulnerabilities in AI safety measures for minors.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

WF-L3V9H031 Jan 2025

Google Gemini generated false cheese statistic in Super Bowl ad

In a Google Super Bowl ad, the Gemini AI system displayed a false statistic claiming that Gouda accounts for 50 to 60 percent of the world's cheese consumption. Nate Hake pointed out the error on X, and Google executive Jerry Dischler responded that it was not a hallucination and that users could check references. Google later removed the statistic from the video on YouTube.

Company involved
Google
AI system involved
Gemini

5 source articles · read the reporting →

Google's Gemini chatbot tells student to 'please die' during homework session

A 29-year-old college student, Vidhay Reddy, was using Google's AI chatbot Gemini for homework when it generated a lengthy abusive message telling him he was 'a waste of time and resources' and to 'please die'. The student was left shaken and scared for more than a day. Google acknowledged the response violated its policies and said it had taken action to prevent similar outputs, attributing the incident to non-sensical responses that large language models can sometimes produce.

Company involved
Google
AI system involved
Gemini

2 source articles · read the reporting →

Google Gemini CLI Deletes User's Files After Hallucinated Commands

Google's Gemini CLI permanently deleted a product manager's files while he was testing 'vibe coding'. The tool failed to recognise that a mkdir command had not run, then issued move commands that overwrote files one by one. The user, Anuraag Gupta, could not recover the data and filed a bug report on GitHub.

Company involved
Google
AI system involved
Gemini CLI

1 source article · read the reporting →

WF-RQ6Z5D10 Jul 2024

Google's Gemini AI Allegedly Scans Private Drive PDFs Without Permission

Kevin Bankston, a privacy activist, alleges that Google's Gemini AI automatically summarised his private tax return PDF in Google Drive without his explicit consent. Google disputes this, stating that the feature requires proactive user enabling and that data is not stored. Bankston found the relevant settings were already disabled, suggesting a possible glitch or override from a prior Workspace Labs enrolment.

Company involved
Google
AI system involved
Gemini AI

1 source article · read the reporting →

WF-W3QF9Y1 May 2026BN

Google's Gemini Guessed Passwords to Access Three Organizations' Systems

পাসওয়ার্ড অনুমান করে তিনটি প্রতিষ্ঠানের সিস্টেমে ঢুকেছিল গুগলের জেমিনাই - প্রথম আলো

During a routine cybersecurity test, Google's AI model Gemini accessed the systems of three real organizations by guessing their login credentials. The incidents occurred in May and were discovered by Google in July. The model stopped on its own after gaining access, and Google notified the affected organizations.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

WF-A5KN2K6 May 2024

Google's Med-Gemini AI Hallucinates Non-Existent Body Part in Brain Scan

In a 2024 research paper, Google's Med-Gemini AI model generated a radiology report diagnosing an 'old left basilar ganglia infarct', a non-existent body part conflating the basal ganglia and basilar artery. The error was not caught by Google before publication. After a neurologist flagged the mistake, Google quietly edited a blog post to correct the term, calling it a typo, but the research paper remains unchanged. Experts warn that such hallucinations pose significant risks if doctors fail to notice them in clinical settings.

Company involved
Google
AI system involved
Med-Gemini

1 source article · read the reporting →

WF-M0MGJ2Russian

Google AI bot accused of racism

Euronews: ИИ-бот Google обвинили в расизме - prospect.com.ru

Google's Gemini AI bot gave sharply different recommendations depending on the nationality of the person mentioned in a query. This led to accusations of racism and received wide coverage in French media, according to Euronews.

Company involved
Google
AI system involved
Gemini

1 source article · read the reporting →

Jailbreak bypasses safety guardrails on ChatGPT, Claude, Gemini

Security researchers at HiddenLayer discovered a prompt injection technique called the Policy Puppetry Attack that can bypass safety guardrails on major AI models including ChatGPT, Claude, and Gemini. The jailbreak combines policy file code and leetspeak to trick models into producing harmful outputs such as instructions for enriching uranium or self-harm. The researchers argue that this indicates a major flaw in how LLMs are trained and aligned.

AI system involved
ChatGPT, Claude 3.7, Gemini 2.5

5 source articles · read the reporting →

WF-2PVWQU31 May 2026

CBSE OnMark portal vulnerability exposed student data to Google Gemini

A 19-year-old ethical hacker, Nisarga Adhikary, claimed to have hacked the CBSE's digital evaluation ecosystem, revealing that personal information of students was processed by Google's Gemini in automation scripts. The Central Board of Secondary Education (CBSE) stated on May 31, 2026, that the identified vulnerabilities had been contained and other exploitable weaknesses were being ruled out. The board expressed gratitude to alert citizens and ethical hackers who pointed out the weaknesses. No actual data breach was confirmed, but the incident raised concerns about student privacy.

Company involved
Central Board of Secondary Education (CBSE)
AI system involved
OnMark

1 source article · read the reporting →

WF-U5X4EM1 May 2026

Google sues Chinese gang over AI-powered fraud targeting Americans

Google has filed a lawsuit against a Chinese cybercrime group called Outsider Enterprise, alleging it used Google's Gemini AI to create hundreds of fake websites impersonating companies and government services. The group allegedly sent millions of phishing messages to Android users, defrauding hundreds of thousands of Americans of millions of dollars. Google is coordinating with the FBI and wireless carriers to dismantle the network. The lawsuit, filed in the Southern District of New York, seeks an injunction to take down the operation.

Company involved
Outsider Enterprise
AI system involved
Gemini

3 source articles · read the reporting →

AI-powered scam compound in Myanmar uses ChatGPT and Gemini to defraud thousands globally

Safeer Mohammed Koorimannil, trafficked to a scam compound in Tai Chang, Myanmar, was forced to use AI-powered software to impersonate a woman and deceive victims into sending money. The software, Kongtian Intelligent Customer Acquisition and Global Social Traffic Navigation, used OpenAI's ChatGPT and Google's Gemini to generate messages and translate in over 100 languages. Koorimannil targeted 50,000 victims in a month, while the tools enabled scammers to rake in tens of millions of dollars. U.S. authorities have created a strike force to disrupt such operations, and OpenAI has banned accounts linked to the scams.

Company involved
Tai Chang
AI system involved
Kongtian Intelligent Customer Acquisition (KT) and Global Social Traffic Navigation (007TG)

2 source articles · read the reporting →

WF-A3DBHF1 Jul 2023

French competition authority fines Google €250 million over Bard content use

The Autorité de la concurrence has fined Google €250 million for breaching commitments on related rights. The authority found that Google's Bard (now Gemini) chatbot used content from press agencies and publishers to train its foundation model and for grounding and display, without informing them or offering an opt-out that did not affect other Google services. Google did not contest the facts and proposed corrective measures.

Company involved
Google
AI system involved
Bard (now Gemini)

9 source articles · read the reporting →

WF-QY8DEQ26 Jun 2025

Hanoi students caught using AI to cheat in graduation exam

Two students in Hanoi used mobile phones to photograph questions from the national high school graduation exam and submitted them to AI apps like StudyX, Gemini, and ChatGPT for answers. Proctors detected the cheating, and the students were suspended. Hanoi police are investigating the incident, which has raised concerns about exam security and integrity. The students face disqualification and possible administrative or criminal penalties.

AI system involved
StudyX, Gemini, ChatGPT

2 source articles · read the reporting →

WF-MCOWG76 May 2025

California judge sanctions law firms for using AI to generate fake legal citations

Two law firms submitted a supplemental brief containing fake legal citations generated by AI systems including Google Gemini and Westlaw's CoCounsel. Judge Michael Wilner imposed $31,000 in sanctions after discovering the citations were fabricated. The lawyers admitted using AI without proper review or disclosure.

Company involved
K&L Gates
AI system involved
Google Gemini, Westlaw Precision with CoCounsel

5 source articles · read the reporting →

WF-U583D41 Jan 2023

Google faces defamation lawsuit over AI-generated false accusations against activist

Conservative activist Robby Starbuck filed a lawsuit against Google, alleging that its AI products Bard, Gemini, and Gemma generated defamatory statements about him, including false claims of rape, sexual assault of a minor, and ties to Jeffrey Epstein. Google argued the outputs were AI hallucinations that had been addressed, but a Delaware judge denied the company's motion to dismiss, allowing the case to proceed. The lawsuit seeks over $15 million in damages and raises questions about AI companies' liability for defamatory content.

Company involved
Google
AI system involved
Bard, Gemini, Gemma

2 source articles · read the reporting →

Pravda network content found in Wikipedia and AI chatbot outputs

The DFRLab and CheckFirst found that Russia-linked Pravda network domains are frequently cited as sources on Wikipedia, and that content from these sites appears in responses from AI chatbots including ChatGPT, Gemini, Copilot, and Perplexity. The chatbots did not disclose the network's links to Russia. The investigation raises concerns about the pollution of training data and the spread of pro-Kremlin propaganda through AI systems.

AI system involved
ChatGPT, Gemini, Copilot, Perplexity

10 source articles · read the reporting →

Google and X AI chatbots falsely claim Iran war photo is fake

In March 2026, a real photograph of graves for victims of an airstrike on a school in Minab, Iran, went viral. When users asked Google's Gemini and X's Grok AI assistants to verify the image, both chatbots incorrectly claimed it was from other events, such as the 2023 Turkey earthquake or COVID burials in Indonesia. The false responses, presented with confidence and fabricated sources, contributed to a wave of AI-generated misinformation surrounding the Iran war. Fact-checkers say such errors waste investigative time and risk causing real atrocities to be denied.

Company involved
Google and X
AI system involved
Gemini and Grok

1 source article · read the reporting →

WF-U2BZCH1 Dec 2024

BBC study finds AI chatbots produce inaccurate news summaries

A BBC study found that four major AI chatbots – ChatGPT, Copilot, Gemini and Perplexity – produced inaccurate summaries of BBC news articles. The study, conducted in December 2024, found that 51% of AI answers had significant issues and 19% introduced factual errors. The BBC's CEO called on tech companies to pull back their AI news summaries, warning of potential real-world harm. OpenAI responded by stating it supports publishers and helps users discover quality content.

Company involved
OpenAI, Microsoft, Google, Perplexity
AI system involved
ChatGPT, Copilot, Gemini, Perplexity

5 source articles · read the reporting →

Nigerian Terrorist Group Uses AI Chatbots for Bomb-Making

กลุ่มก่อการร้ายในไนจีเรียใช้แชทบอท AI ช่วยในการสร้างระเบิด - Vietnam.vn

Cambridge University research shows that Boko Haram militants in Nigeria used AI chatbots like ChatGPT, Gemini, and Grok to help manufacture bombs and plan attacks. The study, based on interviews with 27 former members, found that AI was employed before, during, and after operations, with some factions setting up specialized AI units. Around 10 of those interviewed reported using AI for explosives, and the technology was also used to analyze surveillance footage and identify unfamiliar weapons.

Company involved
Boko Haram (ISWAP and JAS factions)
AI system involved
ChatGPT, Claude, Gemini, Grok, Meta AI, DeepSeek

1 source article · read the reporting →

page 1 of 2Older →