Paul Zilly sentencing prompts algorithmic fairness controversy
The sentencing of Paul Zilly sparked controversy over algorithmic fairness in criminal justice when a judge doubled his prison time based on an algorithmic risk assessment tool's prediction. What happened Paul Zilly was convicted of stealing a lawnmower and tools in Wisconsin, USA. Despite a plea deal recommending one year in county jail, Judge James Babler rejected it after viewing Zilly's COMPAS risk scores, which rated him as high risk for future violent crime and medium risk for general recidivism. The judge increased Zilly's sentence to two years in state prison, citing the risk assessment as "about as bad as it could be." Wh y it happened The incident occurred due to: Overreliance on AI. J udge Babler heavily weighted the COMPAS algorithm's prediction, despite its intended use for correctional authorities rather than sentencing. Algorithmic bias. COMPAS and similar tools have been found to exhibit racial biases, often unfairly flagging African American defendants as high risk compared to white defendants. Lack of transparency. The proprietary nature of COMPAS prevented scrutiny of its algorithms, making it impossible to verify the integrity of its risk scores. What it means The fracas is seen to highlight the potential for algorithmic systems to exacerbate existing biases in the criminal justice system, and underscored the need for greater transparency, accountabilit and fairness when these system are used in criminal justice. It also prompted discussion about the appropriate role of algorithms in legal proceedings and the importance of human judgement in sentencing decisions. System 🤖 Equivant 🔗 Operator: Wisconsin Court System Developer: Volaris Group/Equivant/Northpointe Country: USA Sector: Govt - justice Purpose: Assess recidivism risk Technology: Recidivism risk assessment system Issue: Accountability; Accuracy/reliability; Automation bias; Fairness; Human rights/civil liberties; Transparency
- Date it happened
- 2013-01-01
- Organisation involved
- Wisconsin Court System
- Product, system or model
- Correctional Offender Management Profiling for Alternative Sanctions (COMPAS)
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.