A proposal and assessment of an improved heuristic for the Eager Test smell detection

TL;DR

This paper introduces a new heuristic for detecting the Eager Test smell in unit tests, improving accuracy over existing simplified rules through literature review and manual validation on Java test cases.

Contribution

It proposes a clear, unambiguous definition of the Eager Test smell and a novel heuristic that enhances detection precision compared to prior rules.

Findings

Heuristic detects patterns missed by existing rules

Improved detection accuracy and consistency

Addresses practitioners' concerns about detection adequacy

Abstract

Context: The evidence for the prevalence of test smells at the unit testing level has relied on the accuracy of detection tools, which have seen intense research in the last two decades. The Eager Test smell, one of the most prevalent, is often identified using simplified detection rules that practitioners find inadequate. Objective: We aim to improve the rules for detecting the Eager Test smell. Method: We reviewed the literature on test smells to analyze the definitions and detection rules of the Eager Test smell. We proposed a novel, unambiguous definition of the test smell and a heuristic to address the limitations of the existing rules. We evaluated our heuristic against existing detection rules by manually applying it to 300 unit test cases in Java. Results: Our review identified 56 relevant studies. We found that inadequate interpretations of original definitions of the Eager Test smell led to imprecise detection rules, resulting in a high level of disagreement in detection outcomes. Also, our heuristic detected patterns of eager and non-eager tests that existing rules missed. Conclusion: Our heuristic captures the essence of the Eager Test smell more precisely; hence, it may address practitioners' concerns regarding the adequacy of existing detection rules.