NEDA eating disorder chatbot sparks employee backlash
The US National Eating Disorder Association (NEDA) replaced the team of staff and volunteers manning a popular and reputable helpline with an inaccurate and unreliable chatbot, resulting in a backlash . Under pressure from surging demand for eating disorder and 'crisis-type' advice, NEDA's helpline team decided to unionise to ensure a safer and more productive work environment. They were fired four days after they unionised, though NEDA said the two were unrelated. C it ing concerns over legal liabilities and operational efficiency , NEDA responded by saying it would replace the helpline and its team with 'Tessa', a mental health chatbot. However, initial evaluations of the new bot suggested it had some way to go before it was able to provide relevant, effective advice in an appropriate manner, prompting complaints by NEDA staff and volunteers, who The new chatbot was taken offline two days before it was officially due to launch after it was found to have been encouraging unhealthy eating habits rather than helping someone who said she had an eating disorder. System 🤖 Tessa Documents 📃 Cass AI. Meet Tessa NEDA (2023). Chatbot suspension statement Operator: National Eating Disorder Association (NEDA) Developer: Cass Country: USA Sector: NGO/non-profit/social enterprise Purpose: Provide mental health support Technology: Chatbot; Machine learning Issue: Accuracy/reliability; Employment; Mis/disinformation; Transparency
- Date it happened
- 2023-05-01
- Organisation involved
- National Eating Disorder Association (NEDA)
- Product, system or model
- Tessa
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.