← the record
AIAAIC-0758

NarxCare accused of wrongly denying patients opioids

A software system used to determine the risk of drug addiction was accused of denying users opioids on the basis it wrongly reckoned they were at risk of addiction. Developed by Bamboo Health (for merly named Appriss), NarxCare is used across several US states to track prescriptions for drugs such as opioids and purports to identify and flag patients with ‘drug-shopping’ behaviours - people who might be lying to doctors about the pain they’re in in order to get tneir hands on opioids. While marketed as a "decision support tool," i n some cases the system recommended denying painkillers to people who suffer from severe pain and have no history of drug abuse, according to WIRED. Patients denied legal prescriptions have reported severe physical suffering, mental health crises, and, in some cases, being forced toward the illicit drug market to manage "unbearable" pain. The system was also accused of reinforcing existing racial and gender biases. Bamboo Health considers the NarxCare algorithm a trade secret. Because the formula is not public, neither doctors nor patients can verify how a score is calculated or challenge inaccuracies. System 🤖 NarxCare Developer: Appriss Country: USA Sector: Health Purpose: Assess & predict drug abuse Technology: Risk assessment algorithm Issue: Accountability; Accuracy/reliability; Fairness; Transparency

Date it happened
2021-08-01
Organisation involved
US Department of Justice; Rite Aid; Walmart; Sam's Club
Product, system or model
NarxCare
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.