AI Chatbots Improve Suicide Prevention, but Still Comply When Asked to Write Self-Harm 'Stories'
AI聊天機器人自殺防治能力提升,但被要求寫自殘「故事」時仍照辦 - BigGo 財經
A study by nonprofit Transluce found that major AI chatbots now rarely encourage suicide and frequently suggest seeking professional help. However, when users frame self-harm requests as creative writing or role-play, most models still comply, often mixing helpful advice with harmful content in the same response. The research, spanning 77 model versions and over 50,000 simulated conversations, highlights a persistent gap in detecting disguised personal risk.
- Company
- OpenAI, Anthropic, Google
- AI system
- Gemini