Commentary on Guyll et al. (2023): Misuse of Statistical Method Results in Highly Biased Interpretation of Forensic Evidence

TL;DR

This paper critiques a recent forensic science study for its statistical errors, highlighting the importance of accurate methods in evaluating forensic evidence to prevent biased legal outcomes.

Contribution

It provides a critical commentary on the misuse of statistical methods in forensic science research, emphasizing the need for proper analysis to ensure validity.

Findings

Identifies a serious statistical error in Guyll et al. (2023)

Highlights potential bias in forensic evidence interpretation

Underscores legal implications of statistical inaccuracies

Abstract

Since the National Academy of Sciences released their report outlining paths for improving reliability, standards, and policies in the forensic sciences NAS (2009), there has been heightened interest in evaluating and improving the scientific validity within forensic science disciplines. Guyll et al. (2023) seek to evaluate the validity of forensic cartridge-case comparisons. However, they make a serious statistical error that leads to highly inflated claims about the probability that a cartridge case from a crime scene was fired from a reference gun, typically a gun found in the possession of a defendant. It is urgent to address this error since these claims, which are generally biased against defendants, are being presented by the prosecution in an ongoing homicide case where the defendant faces the possibility of a lengthy prison sentence (DC Superior Court, 2023).