Google AI Giving Staggeringly Racist "Advice" About Being Alone With Certain Groups of People - Futurism
The system advised users about personal safety when alone with people of certain nationalities, prompting them to call emergency services for some groups.
- Company involved
- Google
- AI system involved
- AI Overviews
1 source article · read the reporting →
Gmail users warned of AI voice phishing scam impersonating Google support
Cybercriminals are using AI-generated voices to impersonate Google support in phone calls to Gmail users, attempting to trick them into revealing account credentials. The scam involves a caller ID that appears legitimate and a follow-up email from a spoofed Google address. Victims are told their account has been compromised and are asked to provide a recovery code. Google has advised users to enable Advanced Protection to secure their accounts.
8 source articles · read the reporting →
Google AI Search Shows Product Prices 21.6% Higher
بحث غوغل بالذكاء الاصطناعي يعرض أسعارًا أعلى بـ 21.6% للمنتجات - وكالة عمون الاخبارية
A study found that Google's AI Mode shows the same products at prices 21.6% higher on average compared to traditional search. The primary seller for the same product differed nearly 50% of the time, suggesting AI Mode prioritizes different sellers and is less focused on low prices. Google stated that all shopping results, including AI Mode, use the same Shopping Graph data source.
- Company involved
- Google
- AI system involved
- AI Mode
1 source article · read the reporting →
Nearly Stranded in Africa After Using AI Chatbot for Travel Planning
Suýt mắc kẹt tại châu Phi vì nhờ chatbot AI lên kế hoạch du lịch - Một Thế Giới
A traveler almost got stuck in Africa after relying on an AI chatbot to plan the trip. The chatbot's itinerary led to unforeseen complications, nearly leaving the person stranded.
1 source article · read the reporting →
Google shows AI-generated images in Edward Hopper search results
Illustrator Penny Neville-Lee reported that searching for Edward Hopper on Google returned AI-generated images instead of authentic artworks. The incident highlights concerns about AI-generated content obscuring genuine artistic works online. No response from Google is mentioned.
- Company involved
- Google
- AI system involved
- Google Image Search
2 source articles · read the reporting →
Google's Ad System Shows Gender Bias in Job Ads, Study Finds
Researchers from Carnegie Mellon University and the International Computer Science Institute used a tool called AdFisher to probe Google's ad-targeting system. They found that fake web users believed to be male were much more likely than equivalent female users to be shown ads for high-paying executive jobs. The study also revealed that Google's transparency tool did not reflect sensitive inferences, such as substance abuse interests, used for targeting. Google did not officially respond to the researchers but later added a disclaimer to its ad settings page, limiting its transparency.
- Company involved
- Google
- AI system involved
- Google ad-targeting system
10 source articles · read the reporting →
Uber's Secretive 'Upfront Fares' Algorithm Cuts Driver Pay in Many Cities
Uber introduced an opaque algorithm called 'Upfront Fares' to calculate driver pay in 24 U.S. cities, replacing the previous time-and-distance-based rate. Drivers report lower and unpredictable earnings, with Uber taking a larger cut of fares. The company claims the change gives drivers more control, but critics say the secrecy makes it impossible to verify fair pay. The algorithm may learn the lowest rate drivers will accept, potentially driving down wages.
- Company involved
- Uber
- AI system involved
- Upfront Fares
3 source articles · read the reporting →
Google's Search AI Gives False Geography Answers, Including Denying Kenya Exists
Google's AI-powered Search Generative Experience (SGE) was found to provide incorrect answers to geography questions, such as claiming no African country starts with 'K' despite Kenya. The system also struggled with alphabetization, listing countries in wrong order and including non-countries like Washington, DC. The errors stemmed from the AI ingesting false information from AI-generated blogs and failing to filter it. Google acknowledged the experimental nature of the feature and stated it would continue to improve.
- Company involved
- Google
- AI system involved
- Google SGE
2 source articles · read the reporting →
Google's ad portal suggested porn keywords for 'Black girls'
Google's Keyword Planner, used by advertisers to select search terms, suggested hundreds of pornographic keywords when users searched for 'Black girls', 'Latina girls', and 'Asian girls', but returned no suggestions for 'White girls' or 'White boys'. The Markup reported that Google's own adult filter flagged many of these terms, but the system still recommended them. Google acknowledged the issue, removed the terms, and said it was working to prevent recurrence.
- Company involved
- Google
- AI system involved
- Google Ads Keyword Planner
9 source articles · read the reporting →
Google Search Displays AI-Generated Vermeer as Top Result
Google's search engine displayed an AI-generated version of Johannes Vermeer's 'Girl with a Pearl Earring' as the top result for the artist's name. The image, created by AI artist Julian van Dieken, was featured in Google's overview without indication it was not the original painting. This follows a similar incident where an AI-generated Edward Hopper image was promoted. Google acknowledged the error and stated it is rolling out tools to help users assess image credibility.
- Company involved
- Google
- AI system involved
- Google Search
1 source article · read the reporting →
Google AI Overview shows AI-generated mushroom images, experts warn
Google's AI Overview returned AI-generated images of mushrooms that did not match the species, leading experts to warn that foragers could be poisoned. The images appeared as top results for searches of edible mushrooms and were flagged as AI-generated. A Reddit moderator reported the issue to Google, and a Google spokesperson said the company was looking into it.
- Company involved
- Google
- AI system involved
- Google AI Overview
5 source articles · read the reporting →
Ryanair requires facial recognition for customers booking via online travel agents
noyb filed a complaint against Ryanair with the Spanish Data Protection Authority (AEPD) on 27 July 2023. A customer who booked a Ryanair flight through online travel agency eDreams was required to undergo a facial recognition verification process or go to the check-in counter more than two hours before departure. The customer was charged a small fee for the verification. Ryanair outsources the facial recognition to GetID. noyb alleges that the process violates GDPR because consent is not valid and the purpose is to discourage bookings through third-party agents.
- Company involved
- Ryanair
- AI system involved
- GetID
10 source articles · read the reporting →
Google AI directs traveller to scam customer service number
Alex Rivlin used Google to find a cruise company's customer service number while booking a shuttle for a European holiday. Google's AI surfaced a number that connected him to a knowledgeable-sounding representative, to whom he gave his credit card details. The number was a scam, representing a new AI-enabled twist on a long-running travel fraud. The article warns readers about this evolving threat.
- Company involved
- Google
- AI system involved
- Google AI Overviews
1 source article · read the reporting →
Gamma AI Presentation Tool Exploited in Multi-Stage Phishing Campaign
Threat actors used Gamma, an AI-powered presentation builder, to host a page that redirected recipients to a fake Microsoft SharePoint login portal. Emails sent from compromised legitimate accounts passed authentication checks, while a Cloudflare Turnstile blocked automated security scanners. An adversary-in-the-middle framework validated credentials in real time and captured session cookies, enabling multi-factor authentication bypass on Microsoft accounts. Abnormal reported the campaign on 15 April 2025.
- AI system involved
- Gamma
7 source articles · read the reporting →
Grok and Google Lens AI overviews falsely claim fake images show Huntingdon train attack
Grok and Google Lens AI overviews have been claiming that AI-generated images of the Huntingdon train attack are real. Grok told users one image was a genuine photo, while Google Lens claimed it was a still from a BBC news report. The AI systems also linked unrelated videos to the attack. Full Fact contacted Google, which told users they can provide feedback on errors. xAI has not yet responded.
- Company involved
- xAI and Google
- AI system involved
- Grok and Google Lens AI overviews
4 source articles · read the reporting →
Google Flu Trends underestimates US flu outbreak
Google Flu Trends, an automated system using search query data to estimate flu activity, failed to predict the severity of the 2012-2013 US flu outbreak, underestimating the impact. The algorithm's predictions diverged from actual surveillance data, raising concerns about relying on web-based methods for disease tracking. The article reports the discrepancy as a failure of the model.
- Company involved
- Google
- AI system involved
- Google Flu Trends
10 source articles · read the reporting →
Google sues Chinese gang over AI-powered fraud targeting Americans
Google has filed a lawsuit against a Chinese cybercrime group called Outsider Enterprise, alleging it used Google's Gemini AI to create hundreds of fake websites impersonating companies and government services. The group allegedly sent millions of phishing messages to Android users, defrauding hundreds of thousands of Americans of millions of dollars. Google is coordinating with the FBI and wireless carriers to dismantle the network. The lawsuit, filed in the Southern District of New York, seeks an injunction to take down the operation.
- Company involved
- Outsider Enterprise
- AI system involved
- Gemini
3 source articles · read the reporting →
OpenAI's SearchGPT Demo Gives Incorrect Festival Dates
OpenAI announced a prototype AI search tool called SearchGPT. In a prerecorded demo, the tool listed An Appalachian Summer Festival as occurring from July 29 to August 16, but the actual festival ran from June 29 to July 27. The dates provided were for the box office closure. The error highlights the tendency of generative AI models to provide incorrect information.
- Company involved
- OpenAI
- AI system involved
- SearchGPT
2 source articles · read the reporting →
Air Canada Chatbot Fabricates Discount, Leading to Court Case
Air Canada's customer service chatbot allegedly fabricated a discount during a conversation with a customer last year. The incident resulted in a court case against the airline. Insurer Armilla stated that its new AI mishap policy would have covered the loss from selling tickets at the discounted price if the chatbot was found to have underperformed.
- Company involved
- Air Canada
- AI system involved
- chatbot
6 source articles · read the reporting →
Stefanina’s Wentzville warns customers against using Google AI for specials after false information causes anger
Stefanina’s Wentzville, a restaurant in Missouri, posted a warning on social media asking customers not to use Google AI to find their specials. The AI-generated overviews were providing inaccurate information about deals and menu items that did not exist, leading to angry customers yelling at employees. The restaurant stated it could not honour the fake specials and directed customers to its Facebook page or website instead. Google did not respond to requests for comment.
- Company involved
- Google
- AI system involved
- Google AI Overviews
1 source article · read the reporting →
Gradient app charges users unexpected subscription fees after free trial
The Gradient app, a celebrity lookalike app promoted by the Kardashians, charges users $19.99 per month after a three-day free trial without clear disclosure. Users complained on social media about unexpected credit card charges. The app's developer, Ticket to the Moon, has not addressed the billing complaints but denied collecting user data.
- Company involved
- Ticket to the Moon, Inc.
- AI system involved
- Gradient
9 source articles · read the reporting →
Google AI Overviews provide inaccurate finance information in 43% of searches
A study by The College Investor found that Google's AI Overviews provided misleading or inaccurate information in 43% of 100 personal finance-related searches. The AI-generated answers included outdated tax rules and incorrect student loan repayment plan details. One user believed she could convert her 529 plan to a Roth IRA in California, which is not allowed. Google has not responded to requests for comment.
- Company involved
- Google
- AI system involved
- AI Overviews
3 source articles · read the reporting →
Google allowed ads targeting racist search terms, disabled them after inquiry
BuzzFeed News discovered that Google's advertising platform allowed a campaign to target people searching racist phrases, and that Google's keyword tool suggested additional offensive terms. The campaign served 17 ad impressions before Google disabled most of the keywords after being contacted. Google acknowledged the breach of its policies and said it had turned off the suggestions.
- Company involved
- Google
10 source articles · read the reporting →
Google Slapped With Digital Privacy Class Action Over Use of Customer Service AI Product - Law.com
The system intercepted and analyzed customer service calls of Home Depot customers without their consent.
- Company involved
- Google
- AI system involved
- Cloud Contact Center AI
1 source article · read the reporting →