Google SGE recommends malware, fraud sites
Google's AI-powered Search Generative Experience (SGE) is reportedly recommending malicious websites, including ones containing malware and scams. SEO consultant Lily Ray noticed that SGE (since renamed AI Overviews ) was suggesting potentially harmful sites as part of its conversational responses , making it easier for users to fall for scams. These sites often use the same .online domain, HTML templates, and perform redirects, indicating they are part of an SEO poisoning campaign . Clicking on these links leads users through a series of redirects until they reach a scam site comprising fake captchas, deceptive YouTube pages and fake giveaways . Google claims to continuously update its systems and algorithms to combat spam . However, the presence of low-quality and potentially harmful sites in Google’s search results raises questions about the efficacy of the company’s spam-fighting measures and increases the potential for fraud. It is also seen to bring into question the reliability of AI-generated content in general. System 🤖 Google AI Overviews Operator: Alphabet/Google Developer: Alphabet/Google Country: Global Sector: Technology Purpose: Generate search results Technology: Machine learning Issue: Safety; Security
- Date it happened
- 2024-03-01
- Organisation involved
- Product, system or model
- AI Overviews
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.