UK prisoner risk categorisation algorithm poses racism risk
A UK government algorithmic system for categorising prisoners in UK jails risks automating and embedding racism in the system, experts and advocacy groups warned. Developed by Deloitte, the unnamed tool draws on data, including from the prison service, police and the National Crime Agency, to assess what type of prison a person should be put in and how strictly they should be controlled during their sentence. But critics argued the system could result in ethnic minority prisoners being unfairly placed in higher security conditions than white prisoners, exacerbating existing discrimination and meaning higher category prisoners would have fewer opportunities to develop skills and work towards rehabilitation compared with those held in open or lower security jails. The MoJ refused to specify which intelligence systems the new tool used, claiming this information “would be likely to prejudice the maintenance of security and good order”. System 🤖 Unknown Operator: Her Majesty's Prison and Probation Service; Ministry of Justice Developer: Deloitte Country: UK Sector: Govt - j ustice Purpose: Assess offender risk Technology: Risk assessment algorithm Issue: Bias/discrimination - race, ethnicity; Transparency
- Date it happened
- 2019-11-01
- Organisation involved
- Her Majesty's Prison and Probation Service; Ministry of Justice
- Product, system or model
- Digital Categorisation Service
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.