Clinical-grade' AI stress detector fails to work
An AI-powered test that listens for signs of stress in people’s voices and claimed to be 'clinical grade' provides inconsistent results when tested on the same person twice, according to researchers. Cigna's StressWaves Test is a free online tool that uses voice recognition to evaluate and reveal stress levels in 90 seconds by analysing stress through acoustic (sounds, such as tone, pitch, pause, etc.) and semantic (word choices and syntax) patterns. Levels range from 'Extremely Stressed' to 'No Stress', along with a portrait that visualises the effect of stress on the user's body and mind. Cigna marketed StressWaves as 'clinical grade' tool. However, according a detailed, independent evaluation by Arizona State University researchers, the tool gives inconsistent results when tested on the same person twice, calling into question its efficacy and marketing claims. The researchers also call out Cigna's reluctance to share sufficient validation data, making it difficult to evaluate the model. System 🤖 Cigna StressWaves 🔗 Documents Cigna StressWaves Test brochure (pdf) Operator: Cigna Developer: Ellipsis Health Country: USA Sector: Health Purpose: Evaluate stress level Technology: Voice recognition Issue: Accuracy/reliability; Transparency Investigation, assessment, audit 🧐 Yawar B.A., Liss J., Berisha V. (2023). Reliability and validity of a widely-available AI tool for assessment of stress based on speech
- Date it happened
- 2023-01-01
- Organisation involved
- Cigna
- Product, system or model
- StressWaves
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.