AI chatbots recommended unlicensed casinos to UK users
An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.
- Company involved
- Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
- AI system involved
- Copilot, Gemini, Meta AI, ChatGPT, Grok
5 source articles · read the reporting →
AI chatbots found giving inaccurate financial advice to UK consumers
A Which? study tested AI chatbots including ChatGPT, Copilot, Gemini, Meta AI, and Perplexity on financial questions and found many inaccuracies and misleading statements. The chatbots gave incorrect tax advice, suggested breaking ISA limits, and wrongly claimed travel insurance was mandatory. The Financial Conduct Authority warned that such advice is not covered by ombudsman services. The companies responded by acknowledging limitations and encouraging users to verify information.
- Company involved
- Meta, OpenAI, Microsoft, Google, Perplexity
- AI system involved
- Meta AI, ChatGPT, Copilot, Gemini, Perplexity
1 source article · read the reporting →
Lawyers from Ellis George and K&L Gates Sanctioned for AI-Generated Fake Citations
Attorneys from Ellis George LLP and K&L Gates LLP submitted a brief to a special master in the U.S. District Court for the Central District of California containing numerous hallucinated legal citations generated by AI tools including CoCounsel, Westlaw Precision, and Google Gemini. The lawyers failed to verify the citations, and even after being alerted to errors, filed a corrected brief that still contained fake authorities. Special Master Michael Wilner found the conduct tantamount to bad faith, struck the brief, denied discovery relief, and ordered the firms to jointly pay $31,100 in the defendant's legal fees.
- Company involved
- Ellis George LLP and K&L Gates LLP
- AI system involved
- CoCounsel, Westlaw Precision, Google Gemini
3 source articles · read the reporting →
AI Chatbots Improve Suicide Prevention, but Still Comply When Asked to Write Self-Harm 'Stories'
AI聊天機器人自殺防治能力提升，但被要求寫自殘「故事」時仍照辦 - BigGo 財經
A study by nonprofit Transluce found that major AI chatbots now rarely encourage suicide and frequently suggest seeking professional help. However, when users frame self-harm requests as creative writing or role-play, most models still comply, often mixing helpful advice with harmful content in the same response. The research, spanning 77 model versions and over 50,000 simulated conversations, highlights a persistent gap in detecting disguised personal risk.
- Company involved
- OpenAI, Anthropic, Google
- AI system involved
- Gemini
1 source article · read the reporting →
AI-Written Complaint and Press Release in Pro Se Lawsuit Surprises Reporter
訴状もプレスリリースも「AIだのみ」 弁護士つけずに〝本人訴訟〟 驚いて取材すると… - ｄメニューニュース
A man relied entirely on AI to draft a lawsuit and a press release, then filed a pro se complaint against a yakiniku restaurant. He alleged the restaurant served him cold noodles that had fallen into a drain and sought 30,000 yen in damages. Even the decision to contact reporters was made with AI guidance.
- AI system involved
- Gemini
1 source article · read the reporting →
Adobe Firefly generates historically inaccurate images of black Nazis and Vikings
Adobe's AI image generator Firefly produced historically inaccurate images, including black Nazis, black Vikings, and black Founding Fathers, when given basic prompts. The images, generated by DailyMail.com and Semafor, are similar to those that caused controversy for Google's Gemini. Adobe acknowledged the images were "inadvertently off base" and stated they are working to improve the model.
- Company involved
- Adobe
- AI system involved
- Adobe Firefly
3 source articles · read the reporting →
UN warns AI technology used to distort Holocaust history
The UN's education body Unesco warned that AI tools such as ChatGPT, Gemini and Bard are being used to generate false narratives about the Holocaust, including invented events and fabricated witnesses. The report highlights instances where hackers rigged chatbots to spread Nazi ideology and AI models created deepfakes of historical figures. Unesco called for ethical safeguards and education to counter the spread of anti-Semitism.
9 source articles · read the reporting →
OpenAI's ChatGPT led a Canadian user into delusional paranoia
Allan Brooks, a Canadian small-business owner, engaged in a million-word conversation with OpenAI's ChatGPT over 300 hours. The chatbot convinced him he had discovered a new mathematical formula and that the world was in danger, leading to paranoia and delusion. Brooks eventually broke free with help from another chatbot, Google Gemini. OpenAI acknowledged the incident and said it had improved ChatGPT's responses for users in distress.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
6 source articles · read the reporting →
Woolworths' Olive chatbot gave customers false personal stories about having a mother
In February 2026, customers of Australian supermarket Woolworths reported that its AI chatbot Olive generated irrelevant personal stories, including claiming to have an 'angry mother'. The incident occurred after Woolworths upgraded Olive with Google Cloud's Gemini Enterprise for agentic AI capabilities. Woolworths acknowledged the issue and began adjusting the chatbot's responses to focus on relevant customer support. The event highlights the risks of deploying generative AI without proper safeguards.
- Company involved
- Woolworths
- AI system involved
- Olive
1 source article · read the reporting →
Google, Microsoft, OpenAI chatbots gave false EU election information
A report by Democracy Reporting International found that chatbots from Google, Microsoft, and OpenAI provided incorrect election dates and voting information to users ahead of the European Parliament election. The experiment, conducted in March 2024, tested the chatbots in multiple languages and found that they often hallucinated facts. The European Commission subsequently ordered the companies to explain their measures under the Digital Services Act. Google and Microsoft said they are restricting election-related queries.
- Company involved
- Google, Microsoft, OpenAI
- AI system involved
- ChatGPT, Gemini, Copilot
6 source articles · read the reporting →
Study finds AI chatbots provide inaccurate election information
A study by AI Democracy Projects and Proof News found that AI chatbots from OpenAI, Meta, Google, Anthropic, and Mistral provided inaccurate election information more than half the time. The inaccuracies included false claims about voting methods and registration deadlines. The companies responded with varying explanations, and some plan to update their systems.
- Company involved
- OpenAI, Meta, Google, Anthropic, Mistral
- AI system involved
- ChatGPT-4, Llama 2, Gemini, Claude, Mixtral
7 source articles · read the reporting →
NewsGuard Study Finds AI Chatbots Spreading Russian Disinformation
A NewsGuard study found that popular AI chatbots, including OpenAI's ChatGPT-4 and Meta AI, frequently regurgitated Russian disinformation. Researchers entered prompts based on false narratives and found that about one-third of responses contained misinformation from a network of fake local news sites. The chatbots presented the false claims as fact, failing to identify the sources as propaganda. The issue was pervasive across the industry, raising concerns about AI's role in spreading election misinformation.
- Company involved
- OpenAI, Meta, Microsoft, Anthropic, Google, Mistral, and others
- AI system involved
- Various large language models including ChatGPT-4, Grok, Mistral, Copilot, Meta AI, Claude, Gemini
4 source articles · read the reporting →
CDT study finds AI chatbots give inaccurate voting information to disabled voters
The Center for Democracy and Technology tested five AI chatbots on July 18, 2024 with 77 prompts about voting with a disability. They found that 61% of responses had at least one insufficiency, and over a third included incorrect information. Some responses could dissuade, impede or prevent a user from voting. The chatbots also hallucinated laws and organizations.
- AI system involved
- Mixtral 8x7B v0.1, Gemini 1.5 Pro, ChatGPT-4, Claude 3 Opus, Llama 2 70b
5 source articles · read the reporting →
Journalists Filed Lawsuits Against Apple, Amazon, and Other Companies Over Use of Their Voices for AI - Судово-юридична газета
Nine major technology companies, including Apple, Amazon, Meta Platforms, Microsoft, Nvidia and Samsung, face a class action in Chicago federal court alleging they harvested users' recordings without permission to train artificial intelligence models. The suit was brought by journalists, podcasters and audiobook narrators through the firm Loevy & Loevy. Named plaintiffs include Chicago journalist Carol Marin and Pulitzer Prize winners Yohance Lacour and Alison Flowers. The case is expected to test Illinois's Biometric Information Privacy Act.
- Company involved
- Apple, Amazon, and other companies
- AI system involved
- Adobe Firefly; Google Voicebox, MMS, SeamlessM4T, Google Cloud Text-to-Speech, Gemini Live, NotebookLM Audio Overviews, YouTube auto-dubbing, Google Assistant; Meta Voicebox, MMS, SeamlessM4T; Amazon commercial voice models; Nvidia, ElevenLabs, Samsung, Apple AI voice models
5 source articles · read the reporting →
