lllinois ends 'unreliable' child abuse predictive system
A system used to identify children at risk from serious injury or death was dumped by the Illinois Department of Children and Family Services (DCFS) after the agency’s director called the technology 'unreliable'. The DCFS said it was suspending use of the Eckerd Rapid Safety Feedback (ERSF) programme as it 'didn’t seem to be predicting much.' According to the Chicago Tribune , the automated system was 'riddled' with data entry errors. Eckerd Connects, the developer of the system, mined electronic DCFS files and assigned a score of 1 to 100 to children who were the subject of an abuse allegation. The algorithms rated the children’s risk of being killed or severely injured. Eckerd Connects acknowledged that it had over-claimed the system's capabilities. System 🤖 Eckerd Connects 🔗 Operator: Illinois Department of Children and Family Services (DCFS) Developer: Eckerd Connects; Mindshare Technology Country: USA Sector: Govt - welfare Purpose: Prediction algorithm Technology: Predict child abuse Issue: Accuracy/reliability; Transparency
- Date it happened
- 2017-01-01
- Organisation involved
- Illinois Department of Children and Family Services (DCFS)
- Product, system or model
- Eckerd Rapid Safety Feedback (ERSF)
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.