The record

Where automated decisions went wrong

Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.

Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.

Clear

157 incidents involving Google · search all text for “Google” instead · public reporting

WF-D9FET910 Feb 2025

NHK AI Translation Error Uses Chinese Name for Senkaku Islands

NHK's English language news report on the Japan-U.S. summit talks used Chinese subtitles that referred to the Senkaku Islands as the Diaoyu Islands. The error was caused by an instant automatic translation system using Google's AI. NHK terminated its multilingual subtitling service in nine languages following the incident, with its president stating the service was not appropriate due to unstable translations.

Company involved
NHK
AI system involved
automatic translation system

3 source articles · read the reporting →

WF-CAJKXR9 Feb 2025

AI-generated Facebook pages mislead New Zealanders with fake news

A 1News investigation found at least 10 Facebook pages, including 'NZ News Hub', using AI to rewrite legitimate news stories and pair them with unlabelled, fabricated images. The pages dramatised events, manipulated photos of real people including a deceased minor, and attracted thousands of followers. Authorities warned the public about the pages, and experts said they blur the line between real and fake news, eroding trust in media. The page disappeared from Facebook after 1News contacted Meta.

Company involved
NZ News Hub
AI system involved
ChatGPT

1 source article · read the reporting →

WF-L3V9H031 Jan 2025

Google Gemini generated false cheese statistic in Super Bowl ad

In a Google Super Bowl ad, the Gemini AI system displayed a false statistic claiming that Gouda accounts for 50 to 60 percent of the world's cheese consumption. Nate Hake pointed out the error on X, and Google executive Jerry Dischler responded that it was not a hallucination and that users could check references. Google later removed the statistic from the video on YouTube.

Company involved
Google
AI system involved
Gemini

5 source articles · read the reporting →

WF-TW1SCL1 Jan 2025

Google’s AI told lies about this man. He’s going to be allowed to sue. - The Mercury News

Generated false statements that James Keene had killed three women and was serving a life sentence

Company involved
Google
AI system involved
AI Overview

1 source article · read the reporting →

WF-U2BZCH1 Dec 2024

BBC study finds AI chatbots produce inaccurate news summaries

A BBC study found that four major AI chatbots – ChatGPT, Copilot, Gemini and Perplexity – produced inaccurate summaries of BBC news articles. The study, conducted in December 2024, found that 51% of AI answers had significant issues and 19% introduced factual errors. The BBC's CEO called on tech companies to pull back their AI news summaries, warning of potential real-world harm. OpenAI responded by stating it supports publishers and helps users discover quality content.

Company involved
OpenAI, Microsoft, Google, Perplexity
AI system involved
ChatGPT, Copilot, Gemini, Perplexity

5 source articles · read the reporting →

WF-MQ6VHM24 Nov 2024

Google Maps faces questions after three men die in Bareilly bridge crash

Three men died when their car fell from an unfinished bridge in Bareilly, Uttar Pradesh, after Google Maps allegedly directed them onto the route. The bridge had partially collapsed in floods and lacked barricades. Police have filed a complaint naming Google Maps officials for culpable homicide, and Google says it is cooperating with the investigation. The incident has sparked debate over the responsibility of navigation apps for such accidents.

Company involved
Google
AI system involved
Google Maps

2 source articles · read the reporting →

WF-AYQCBO24 Oct 2024

Google, Microsoft, and Perplexity AI search results promote racist IQ data

AI-powered search engines from Google, Microsoft, and Perplexity have been surfacing debunked research promoting race science, including false IQ scores for countries. The systems pulled data from a dataset by Richard Lynn, a known proponent of scientific racism. Google removed the offending Overviews after being contacted by WIRED, but the data still appears in featured snippets and other AI tools.

Company involved
Google, Microsoft, and Perplexity
AI system involved
AI Overviews, Copilot, Perplexity

7 source articles · read the reporting →

WF-BBIPT515 Oct 2024

Google AI Overviews provide inaccurate finance information in 43% of searches

A study by The College Investor found that Google's AI Overviews provided misleading or inaccurate information in 43% of 100 personal finance-related searches. The AI-generated answers included outdated tax rules and incorrect student loan repayment plan details. One user believed she could convert her 529 plan to a Roth IRA in California, which is not allowed. Google has not responded to requests for comment.

Company involved
Google
AI system involved
AI Overviews

3 source articles · read the reporting →

WF-CCRF4K1 Oct 2024

NPR's David Greene sues Google over AI voice cloning in NotebookLM

David Greene, a former NPR host, alleges that Google's NotebookLM tool replicated his voice without permission. He says he was 'completely freaked out' when a colleague asked if he had licensed his voice to the company. Greene is suing Google, claiming the product violated his rights by using an AI-generated voice that sounds like his own. The lawsuit is pending.

Company involved
Google
AI system involved
NotebookLM

1 source article · read the reporting →

WF-9CI2NA22 Aug 2024

Google Pixel 9 tools generate offensive images and fake photos

Google's Pixel Studio and Reimagine features on the Pixel 9 phones are accused of generating offensive, copyrighted images and allowing users to create convincing fake photos. Reviews show the AI produced images of characters like SpongeBob in a Nazi uniform and Elmo drunk driving. Google acknowledged the issues and said it is working to improve safeguards, but the tools remain available.

Company involved
Google
AI system involved
Pixel Studio, Reimagine (Magic Editor)

5 source articles · read the reporting →

WF-0DQKK228 Jul 2024

Google Autocomplete omits Trump assassination attempt suggestions

Google's Autocomplete feature was found to be omitting suggested search terms related to the attempted assassination of Donald Trump on July 13, 2024. Users and politicians, including Donald Trump Jr. and Senator Roger Marshall, accused Google of election interference. Google stated that no manual action was taken and that its systems include protections against predictions associated with political violence. The company said it is working on improvements.

Company involved
Google
AI system involved
Autocomplete

9 source articles · read the reporting →

WF-RQ6Z5D10 Jul 2024

Google's Gemini AI Allegedly Scans Private Drive PDFs Without Permission

Kevin Bankston, a privacy activist, alleges that Google's Gemini AI automatically summarised his private tax return PDF in Google Drive without his explicit consent. Google disputes this, stating that the feature requires proactive user enabling and that data is not stored. Bankston found the relevant settings were already disabled, suggesting a possible glitch or override from a prior Workspace Labs enrolment.

Company involved
Google
AI system involved
Gemini AI

1 source article · read the reporting →

WF-DERCUA30 May 2024

Google Rolls Back AI Overviews After Generating False Information

Google introduced AI Overviews, a generative AI feature in its search engine, which produced inaccurate and misleading summaries, including recommending glue on pizza and eating rocks. Users complained on social media, and Google acknowledged the errors, rolling back the feature and implementing refinements to limit unreliable sources. The company stated it would continue improving the feature.

Company involved
Google
AI system involved
A.I. Overviews

7 source articles · read the reporting →

WF-8Y27ZK19 May 2024

Google AI generates dangerous rattlesnake bite advice

A user searching for rattlesnake range maps on Google was presented with an AI-generated blurb containing first aid advice that contradicts proper procedures for rattlesnake bites. The user reported that the AI told them to do exactly what should not be done. No actual harm was reported, but the advice is considered potentially dangerous.

Company involved
Google
AI system involved
Google AI

10 source articles · read the reporting →

WF-A5KN2K6 May 2024

Google's Med-Gemini AI Hallucinates Non-Existent Body Part in Brain Scan

In a 2024 research paper, Google's Med-Gemini AI model generated a radiology report diagnosing an 'old left basilar ganglia infarct', a non-existent body part conflating the basal ganglia and basilar artery. The error was not caught by Google before publication. After a neurologist flagged the mistake, Google quietly edited a blog post to correct the term, calling it a typo, but the research paper remains unchanged. Experts warn that such hallucinations pose significant risks if doctors fail to notice them in clinical settings.

Company involved
Google
AI system involved
Med-Gemini

1 source article · read the reporting →

WF-YCYZHO5 May 2024

Google Search AI suggests drinking urine to pass kidney stones

Google's Search Generative Experience (SGE) AI recommended drinking urine to pass kidney stones. A user shared a screenshot on X, which went viral. The advice is medically incorrect and potentially dangerous. Google has not responded to the incident.

Company involved
Google
AI system involved
Google Search Generative Experience (SGE)

6 source articles · read the reporting →

WF-O6NPIO22 Mar 2024

Google's SGE recommends spam sites in search answers

Google's Search Generative Experience (SGE) is recommending spam websites as part of its AI-generated answers, according to a viral tweet from SEO expert Lily Ray. The tweet and replies indicate that users are being directed to spam and pornographic sites. The issue appears to be ongoing, with no response from Google yet.

Company involved
Google
AI system involved
SGE (Search Generative Experience)

8 source articles · read the reporting →

WF-QLULHG11 Mar 2024

Google, Microsoft, OpenAI chatbots gave false EU election information

A report by Democracy Reporting International found that chatbots from Google, Microsoft, and OpenAI provided incorrect election dates and voting information to users ahead of the European Parliament election. The experiment, conducted in March 2024, tested the chatbots in multiple languages and found that they often hallucinated facts. The European Commission subsequently ordered the companies to explain their measures under the Digital Services Act. Google and Microsoft said they are restricting election-related queries.

Company involved
Google, Microsoft, OpenAI
AI system involved
ChatGPT, Gemini, Copilot

6 source articles · read the reporting →

WF-156KJJ27 Feb 2024

Study finds AI chatbots provide inaccurate election information

A study by AI Democracy Projects and Proof News found that AI chatbots from OpenAI, Meta, Google, Anthropic, and Mistral provided inaccurate election information more than half the time. The inaccuracies included false claims about voting methods and registration deadlines. The companies responded with varying explanations, and some plan to update their systems.

Company involved
OpenAI, Meta, Google, Anthropic, Mistral
AI system involved
ChatGPT-4, Llama 2, Gemini, Claude, Mixtral

7 source articles · read the reporting →

WF-LK6RRN24 Feb 2024

Google Gemini chatbot gives biased response about PM Narendra Modi

Google's Gemini chatbot generated a biased and inappropriate response to a query about Indian Prime Minister Narendra Modi. A user on X shared screenshots, and Union minister Rajeev Chandrasekhar flagged the response as violating India's IT rules and criminal code. Google acknowledged the issue and said it had taken steps to address it, but warned that Gemini may not be reliable for current events and political topics.

Company involved
Google
AI system involved
Gemini

5 source articles · read the reporting →

WF-JBCO7J24 Oct 2023

Four commercial large language models perpetuate race-based medical misconceptions

A study published in npj Digital Medicine tested four commercial large language models (Bard, ChatGPT, GPT-4, and Claude) for their tendency to propagate discredited race-based medical beliefs. When asked about kidney function, lung capacity, and skin thickness, the models sometimes endorsed debunked racial differences, particularly affecting Black patients. The study concludes that these biases pose a potential hazard and urges caution before using such models in clinical decision-making.

Company involved
Not named in article (refers to commercial LLMs generically as Google's Bard, OpenAI's ChatGPT and GPT-4, and Anthropic's Claude)
AI system involved
Bard, ChatGPT, GPT-4, Claude

6 source articles · read the reporting →

WF-1QY1M326 Sep 2023

Google indexed public Bard chat URLs, raising privacy concerns

In September 2023, users discovered that Google Search was indexing URLs of shared conversations with its Bard chatbot, potentially exposing personal information shared in those chats to anyone via search. Google acknowledged the issue and said it was working to block indexing. By September 28, the conversations were no longer showing up in search results, and Google had fixed the problem.

Company involved
Google
AI system involved
Bard

10 source articles · read the reporting →

WF-TUBJDQ25 Sep 2023

Google Search AI falsely claims eggs can be melted

Google's Search AI featured snippet and its experimental SGE provided false information that eggs can be melted. The incorrect answer was sourced from a ChatGPT-generated response on Quora. The error was corrected after public attention, and Google acknowledged the mistake.

Company involved
Google
AI system involved
Google Search

8 source articles · read the reporting →

WF-6YQRYP20 Sep 2023

Google search shows AI-generated selfie for Tiananmen Square 'tank man'

Google's search engine displayed an AI-generated selfie as the top result for the query 'tank man', replacing the iconic photograph of the Tiananmen Square protest. The image was taken from a Reddit thread on the r/Midjourney community. After 404 Media contacted Google, the company removed the image from its Knowledge Graph and Knowledge Panels, stating that its policies do not allow inaccurate content on public interest topics.

Company involved
Google
AI system involved
Google Search

10 source articles · read the reporting →

← Newerpage 2 of 7Older →