← the record
AIAAIC-0248

Study: UnitedHealth follow-up care algorithm is racially biased

An algorithm used by UnitedHealth Group for follow-up care is systematically biased against Black patients, leading to significant disparities in healthcare access and treatment, researchers say. What happened Designed to predict patient health risks and allocate follow-up care, UnitedHealth Group's ALERT system has been found to classify white patients as being sicker than Black patients with similar health conditions. This misclassification results in a lower percentage of Black patients receiving necessary care management services - only 18 percent of those identified as needing more care were Black, while the expected proportion should have been closer to 46 percent. Why it happened The underlying issue stems from the algorithm's reliance on historical healthcare spending as a proxy for health needs, which fails to account for the unequal access to care then experienced by Black patients . Consequently, Black patients, who are often sicker but have had less healthcare expenditure historically, are overlooked by the algorithm . What it means For those impacted, bias of this type can lead to inadequate treatment for serious health conditions among Black patients, exacerbating health disparities and contributing to poorer health outcomes. On a societal level, reliance on biased algorithms reinforces racial inequities in healthcare access and quality, potentially codifying discrimination within medical practices and insurance policies. The findings highlight the need for reform in how algorithms are developed and implemented in healthcare settings to ensure equitable treatment for all patients.

Date it happened
2019-01-01
Product, system or model
ALERT
Where this came from
Share this incident
XLinkedInFacebookWhatsAppEmail
Attribution

This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.