Mapping the Probabilistic AI Ecosystem in Criminal Justice in England and Wales

TL;DR

This paper introduces a systematic mapping methodology to characterize probabilistic AI tools across criminal justice stages in England and Wales, highlighting their usage, impact, and emerging trends like LLMs.

Contribution

It presents a novel systematic approach for mapping probabilistic AI in criminal justice, including data collection methods and initial findings on industry reliance and technological trends.

Findings

Strong reliance on private sector AI providers

Growing interest in generative AI and LLMs

Identification of biases and data protection issues

Abstract

Commercial or in-house developments of probabilistic AI systems are introduced in policing and the wider criminal justice (CJ) system worldwide, often on a force-by-force basis. We developed a systematic way to characterise probabilistic AI tools across the CJ stages in a form of mapping with the aim to provide a coherent presentation of the probabilistic AI ecosystem in CJ. We use the CJ system in England and Wales as a paradigm. This map will help us better understand the extent of AI's usage in this domain (how, when, and by whom), its purpose and potential benefits, its impact on people's lives, compare tools, and identify caveats (bias, obscured or misinterpreted probabilistic outputs, cumulative effects by AI systems feeding each other, and breaches in the protection of sensitive data), as well as opportunities for future implementations. In this paper we present our methodology for systematically mapping the probabilistic AI tools in CJ stages and characterising them based on the modes of data consumption or production. We also explain how we collect the data and present our initial findings. This research is ongoing and we are engaging with UK Police organisations, and government and legal bodies. Our findings so far suggest a strong reliance on private sector providers, and that there is a growing interest in generative technologies and specifically Large Language Models (LLMs).