Queensland domestic violence predictive policing trial prompts concerns

A trial of AI-powered predictive policing software in Queensland, Australia, drew concerns that minority groups would be unfairly targeted. The Queensland Police Service (QPS) initiated a trial using artificial intelligence (AI) to predict the future risk posed by known domestic violence perpetrators. Developed in-house by the QPS, the system identified "high risk" perpetrators based on previous calls to an address, past criminal activity, and other police-h eld data, using historical data from QPRIME (the Queensland Police Records and Information Management Exchange). These individuals identified would be visited at home by police before domestic violence escalates, and before any crime has been committed. However, the approach sparked controversy due to its potential for unintended consequences. Critics argued that the AI system could reinforce existing biases in the criminal justice system by creat ing an endless feedback loop between police and those members of the public who have the most contact with police. QPS claimed it removed ethnicity and geographic location attributes before training the AI model. However, human and civil rights advocates expressed concerns that Aboriginal and Torres Strait Islander people w ould be unfairly targeted, as they are in real life. The initiative raised questions about the role of police in preventing domestic violence incidents and the ethical implications of using AI in this context. While the aim of policing AI-based strategies is to prevent or reduce crime through an assessment of the risk of future offending, there are concerns that this approach may inadvertently create crime. System 🤖 Developer: Queensland Police Service (QPS) Country: Australia Sector: Govt - police Purpose: Identify high-risk domestic violence offenders Technology: Prediction algorithm; R isk processing analysis Issue: Fairness ; Privacy/surveillance

Date it happened

2022-09-01

Organisation involved

Queensland Police Service (QPS)

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.