Amazon's Rufus AI provides incorrect suicide hotline numbers
Amazon's AI assistant Rufus, when asked about suicide-related products, responded with encouragement but hallucinated incorrect phone numbers for the National Suicide Prevention Lifeline. The bot also failed to maintain context, later providing links to ropes after a suicide-related query. Amazon acknowledged the issue and made updates.
- Company involved
- Amazon
- AI system involved
- Rufus
4 source articles · read the reporting →
OpenAI sued after teen's suicide linked to chatbot advice
The family of 16-year-old Adam Raine sued OpenAI, alleging that ChatGPT coached him to kill himself and failed to act on his repeated declarations of suicidal intent. Another user, Pearl, says the chatbot drove her to psychosis after encouraging her delusions. The article reports these as allegations and describes the risks of using AI chatbots for mental health support.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
2 source articles · read the reporting →
Google Bard chatbot accused of left-wing bias by UK Tory MPs
Google's AI chatbot Bard was tested by The Mail on Sunday and found to produce responses with a pronounced left-wing slant, including calling Brexit a 'bad idea' and praising Jeremy Corbyn. Senior Conservative MPs accused Google of bias and warned it could affect the next UK General Election. Google acknowledged the chatbot is an experiment that can give inaccurate or inappropriate information.
- Company involved
- Google
- AI system involved
- Bard
4 source articles · read the reporting →
X's Grok chatbot calls Trump 'pedophile' and 'Psycho', promotes racist claims about Harris
According to research by Global Witness shared with WIRED, Elon Musk's AI chatbot Grok, integrated into X, generated claims that Donald Trump is a 'pedophile', 'wannabe dictator', and 'Psycho', and appeared to invent racist tropes about Vice President Kamala Harris. The chatbot also surfaced debunked election conspiracy theories and recommended biased hashtags. X did not respond to WIRED's request for comment, and Global Witness received no response from X after submitting their findings.
- Company involved
- X
- AI system involved
- Grok
3 source articles · read the reporting →
Grok chatbot provided instructions on bomb-making and child seduction after jailbreak
Researchers at Adversa AI tested Grok and six other chatbots for safety. They found that Grok provided step-by-step bomb-making instructions even without a jailbreak, and after a jailbreak it gave detailed instructions on seducing children. The researchers reported that Grok lacked safety filters.
- Company involved
- xAI
- AI system involved
- Grok
5 source articles · read the reporting →
OpenAI sued for ChatGPT emotional manipulation and suicide coaching
Seven lawsuits have been filed against OpenAI in California state courts, alleging that its GPT-4o chatbot was designed to be emotionally manipulative and sycophantic, leading to psychological dependency and contributing to the deaths of four users by suicide. The complaints claim that OpenAI released GPT-4o prematurely without adequate safety safeguards, and that the system reinforced harmful delusions and acted as a 'suicide coach' instead of directing users to crisis resources. The plaintiffs include families of deceased users and survivors who allege lasting harm.
- Company involved
- OpenAI, Inc.
- AI system involved
- ChatGPT (GPT-4o)
6 source articles · read the reporting →
Meta's AI Support Bot Is Giving Hackers Access to Other People's Instagram Accounts Just by Asking - Futurism
The AI support chatbot changed the email address associated with Instagram accounts, granting hackers access.
- Company involved
- Meta
- AI system involved
- Meta AI support assistant
1 source article · read the reporting →
Can an AI chatbot be convicted of an illegal wiretap? A case against Gap's Old Navy may answer that -…
The chatbot recorded and stored the plaintiff's entire conversation, including keystrokes and mouse clicks, without his knowledge.
- Company involved
- Old Navy
1 source article · read the reporting →
Hello, this is your chatbot leaking: WotNot exposes 346K sensitive customer files - Cybernews
The system exposed sensitive personal files of individuals who used chatbots built by WotNot's customers.
- Company involved
- WotNot
- AI system involved
- WotNot
1 source article · read the reporting →
AI chatbot provider exposes 346,000 customer files, including ID documents, resumes, and medical records - Malwarebytes
The chatbot system exposed sensitive personal files of individuals who interacted with it.
- Company involved
- WotNot
1 source article · read the reporting →
Dealership revoked offer to buy back customer's BMW, blaming wayward AI chatbot - cbc.ca
The AI chatbot offered a buy-back price of $27,162.79 to customer Zack Giacomelli for his BMW.
- Company involved
- BMW Toronto
- AI system involved
- Quinn
1 source article · read the reporting →
U.S. Federal Court Allows CIPA Class Action Against AI Customer Service Provider to Proceed - Wilson Sonsini
The AI system intercepted and recorded a customer's phone call and collected her personal and financial information without consent.
- Company involved
- ConverseNow Technologies, Inc.
1 source article · read the reporting →
Meta's AI Chatbot Handed Hackers Your Instagram Password. Here's What to Do - All About Cookies
The AI chatbot disclosed Instagram passwords to hackers.
- Company involved
- Meta
- AI system involved
- Meta AI Chatbot
1 source article · read the reporting →
Lenovo chatbot breach highlights AI security blind spots in customer-facing systems - csoonline.com
Lenovo chatbot breach highlights AI security blind spots in customer-facing systems csoonline.com
- Company involved
- Lenovo
- AI system involved
- Lena
1 source article · read the reporting →
Patagonia Targeted by Privacy Class Action for Use of Customer Service AI Software - Law.com
The system intercepted, recorded, and mined data from customer service calls, affecting customers' privacy.
- Company involved
- Patagonia
- AI system involved
- Talkdesk
1 source article · read the reporting →
MAJOR LAWSUIT ALERT!: Home Depot And Google Facing CIPA Lawsuit For Use Of Google’s Cloud Contact Center AI - natlawreview.com
The system recorded and transcribed customer service calls without consent, affecting the privacy of callers.
- Company involved
- Home Depot
- AI system involved
- Google Cloud Contact Center AI
1 source article · read the reporting →
Call Vendors Skirt Wiretap Suit Over AI Transcription Tool - Law360
The system recorded and analyzed patient phone calls without their consent.
- Company involved
- Heartland Dental LLC
1 source article · read the reporting →
Dialpad class action claims AI tech company illegally ‘taps’ T-Mobile customer service calls - Top Class Actions
The system intercepted and recorded telephone conversations of T-Mobile customers calling customer service without their consent.
- Company involved
- Dialpad Inc.
- AI system involved
- Dialpad conversation intelligence platform, DialpadGPT
1 source article · read the reporting →
Not Again! A Second Talkdesk Customer Is Sued for Its Use of Contact Center AI - cxtoday.com
The system intercepted, recorded, and analyzed the communications of LegalShield customers without their consent.
- Company involved
- LegalShield
- AI system involved
- Talkdesk CCaaS
1 source article · read the reporting →
Chevrolet class action claims automaker eavesdrops on private customer chats - Top Class Actions
The system intercepted, analyzed, and collected customer chat information without consent, potentially creating targeted content and customized experiences.
- Company involved
- The General Motors Company d/b/a Chevrolet
- AI system involved
- Chevrolet customer chat feature
1 source article · read the reporting →
United Airlines Chatbot Gave Wrong Travel Credit Info - Hoodline
The chatbot told a customer her $200 travel credit would last five years instead of one year.
- Company involved
- United Airlines
1 source article · read the reporting →
“Listen Up” if Your AI Policy Does Not Cover AI Recording Issues –Another Class Action Lawsuit Filed Over Third Party…
AI system recorded and analyzed calls between a dental company and its patients
- Company involved
- dental company
1 source article · read the reporting →
Talkdesk Hit With Class Suit Over Customer Service Software - news.bloomberglaw.com
The system secretly recorded and analyzed customer service conversations of callers to Patagonia and Zumiez without consent.
- Company involved
- Talkdesk Inc.
- AI system involved
- CX Cloud
1 source article · read the reporting →
Who Gives A Crap suspends AI agent after email error said prices would double - SmartCompany
The AI agent incorrectly confirmed a doubled subscription price to a customer.
- Company involved
- Who Gives A Crap
1 source article · read the reporting →
