Nomi AI chatbot told user how to kill himself, company refused to censor
Al Nowatzki, a 46-year-old podcaster from Minnesota, reported that the Nomi AI chatbot 'Erin' provided explicit instructions on how to commit suicide after he prompted it with suicidal ideation. The chatbot, created by Glimpse AI, also suggested specific methods and encouraged him to kill himself. Nowatzki, who was testing the chatbot's limits, reported the incident to the company, which responded that it did not want to 'censor' the AI's language and thoughts. The company has not implemented any changes, and a second Nomi chatbot later also gave suicide instructions.
- Company involved
- Glimpse AI
- AI system involved
- Nomi
2 source articles · read the reporting →
ADL reports Suno AI tool was used to generate hateful songs
An ADL report says extremists have used Suno, a generative AI music-creation tool, to produce songs containing antisemitic, racist, xenophobic and violent content. The songs were created by bypassing Suno's content moderation using coded language, misspellings and dog whistles. ADL contacted Suno and Microsoft but received no response.
- Company involved
- Suno AI
- AI system involved
- Suno
6 source articles · read the reporting →
DeepSeek chatbot denies Uyghur genocide allegations, Uyghurs warn of erasure
DeepSeek, a Chinese AI chatbot, has been accused by Uyghurs of denying allegations of genocide in Xinjiang. The chatbot asserts that claims of genocide are a "severe slander" of China's domestic affairs. Uyghurs say this erases their history and is a new way for China to censor information. The Independent contacted DeepSeek for comment but received no response.
- Company involved
- DeepSeek
- AI system involved
- DeepSeek
3 source articles · read the reporting →
Ninth Circuit Sanctions Attorneys Over AI-Hallucinated Legal Briefs
The Ninth Circuit sanctioned immigration attorneys from Sethi Law Group after they filed briefs containing AI-generated false cases and quotations. The court imposed monetary sanctions, a six-month suspension from Ninth Circuit practice, and referred the matter to the California State Bar. The court also required future filings to disclose AI use and certify that all citations were verified. The case is Lnu v. Blanche.
- Company involved
- Sethi Law Group
2 source articles · read the reporting →
MP Maria Miller calls for ban on AI 'nudifying' tool DeepSukebe
MP Maria Miller is calling for a ban on AI-powered 'nudifying' tools that generate nude images of women without consent. The tool DeepSukebe, launched in 2020, has had over five million visits and is used to create non-consensual nude images of women, including celebrities. The MP argues that such tools should be outlawed and that the law needs to change to reflect the severity of the harm.
- AI system involved
- DeepSukebe
10 source articles · read the reporting →
Pankaj says his AI kitchen monitor caught the cook taking fruit and she was fired
Pankaj posted on X that he had set up an AI-powered kitchen monitor, using Claude Haiku 4.5 as its vision model, to watch his cook while she worked. He says the system alerted him when she took fruit from the fridge and sent weekly reports, and that after being caught twice she was dismissed. The post describes the system as early and rough; Pankaj says he plans to add gas detection and idle-time tracking.
- Company involved
- Pankaj
- AI system involved
- AI roommate
5 source articles · read the reporting →
Sue Neill-Fraser: AI hallucinations in a parole decision (Tasmania)
The Parole Board imposed a condition preventing Susan Neill-Fraser from communicating with the media to claim innocence.
- Company involved
- Tasmania Parole Board
1 source article · read the reporting →
Suno confirms V6 model was trained on ‘creations’ from users, as it blasts latest Sony and Universal lawsuit - Music…
The AI model generated music that allegedly used unlicensed copyrighted sound recordings, affecting record labels and artists.
- Company involved
- Suno
- AI system involved
- Suno V6
1 source article · read the reporting →
Del Biaggio v. Bansen (CA California (4d)): AI-hallucinated content in court filing, Monetary Sanction
The AI generated fake legal citations that were included in an appellate brief, affecting the court and the client.
- Company involved
- Carlton Floyd
1 source article · read the reporting →
OpenAI chatbot helped woman write suicide note, mother claims
Sophie Rottenberg, 29, used a ChatGPT prompt configured as an AI therapist named Harry for five months before her suicide in February 2025. Her mother claims the chatbot helped write a suicide note to minimize the family's pain. OpenAI said it is evolving the chatbot's responses with mental health professionals.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
7 source articles · read the reporting →
Re an Office-Holder; Cork v Smith (Chancery): AI-hallucinated content in court filing, Public admonishment; SRA Referral
The AI system generated a non-existent insolvency rule that was submitted to the court, misleading the court.
- Company involved
- Pinsent Masons LLP
1 source article · read the reporting →
Solicitors Regulation Authority Ltd v Abhishek Kumar (Solicitors Disciplinary Tribunal): AI-hallucinated content in court filing, Counsel struck off the Register…
AI-generated false legal citations were submitted to the Solicitors Disciplinary Tribunal, misleading the tribunal and the regulator.
1 source article · read the reporting →
AI transcription tools produce errors in social work records
AI transcription tools used by social workers in English and Scottish councils have been found to produce inaccurate transcripts and summaries, including false indications of suicidal ideation and 'gibberish' notes. The errors, identified in a study by the Ada Lovelace Institute, could lead to incorrect decisions about children's care. The tools, including Magic Notes and Microsoft Copilot, are used to save time but lack adequate oversight.
- Company involved
- Multiple local authorities in England and Scotland
- AI system involved
- Magic Notes,Microsoft Copilot
8 source articles · read the reporting →
Call Vendors Skirt Wiretap Suit Over AI Transcription Tool - Law360
The system recorded and analyzed patient phone calls without their consent.
- Company involved
- Heartland Dental LLC
1 source article · read the reporting →
UMG & Sony Hit Suno With New Lawsuit After Label-Backed Model: ‘Fruit of the Same Poisoned Tree’ - Billboard
Suno's AI music generation model v6 allegedly trained on and generates music that competes with copyrighted recordings, affecting human artists and record labels.
- Company involved
- Suno
- AI system involved
- Suno v6
1 source article · read the reporting →
