On the Integration of Spectrum-Based Fault Localization Tools into IDEs

TL;DR

This paper discusses integrating Spectrum-Based Fault Localization tools into IDEs, providing recommendations based on surveys and experience to improve their adoption and effectiveness in debugging workflows.

Contribution

It offers a set of functional and non-functional requirements for SBFL tools in IDEs, derived from surveys and expert insights, to facilitate their integration and use.

Findings

Identified key requirements for SBFL tool integration into IDEs

Surveyed existing SBFL tools and their limitations

Provided recommendations to enhance SBFL effectiveness and usability

Abstract

Spectrum-Based Fault Localization (SBFL) is a technique to be used during debugging, the premise of which is that, based on the test case outcomes and code coverage, faulty code elements can be automatically detected. SBFL is popular among researchers because it is lightweight and easy to implement, and there is a lot of potential in it when it comes to research that aims to improve its effectiveness. Despite this, the technique cannot be found in contemporary development and debugging tools, only a handful of research prototypes are available. Reasons for this can be multiple, including the algortihms' sub-optimal effectiveness and other technical weaknesses. But, also the lack of clear functional and non-functional requirements for such a tool, either standalone or integrated into IDEs. In this paper, we attempt to provide such a list in form of recommendations, based on surveying the most popular SBFL tools and on our own researchers' and tool builders' experience.