Do the Defect Prediction Models Really Work?

TL;DR

This paper evaluates the real-world effectiveness of software defect prediction models, questioning their practical utility and trustworthiness in actual software development environments.

Contribution

It provides an initial analysis of binary software defect prediction models' performance in real-time operational settings.

Findings

Preliminary insights into SDP model reliability in practice

Assessment of SDP models' impact on software quality

Identification of challenges in deploying SDP models

Abstract

You may develop a potential prediction model, but how can I trust your model that it will benefit my software?. Using a software defect prediction (SDP) model as a tool, we address this fundamental problem in machine learning research. This is a preliminary work targeted at providing an analysis of the developed binary SDP model in real-time working environments.