RTj: a Java framework for detecting and refactoring rotten green test cases

TL;DR

RTj is a Java framework designed to detect and refactor rotten green test cases, which are passing tests with unexecuted assertions, thereby improving test suite reliability.

Contribution

This paper introduces RTj, a novel automated framework for identifying and refactoring rotten green tests in Java projects, addressing a gap in test quality assurance.

Findings

Discovered 427 rotten tests in 26 open-source Java projects

RTj provides automated recommendations for test refactoring

Improves test suite reliability and developer confidence

Abstract

Rotten green tests are passing tests which have, at least, one assertion not executed. They give developers a false confidence. In this paper, we present, RTj, a framework that analyzes test cases from Java projects with the goal of detecting and refactoring rotten test cases. RTj automatically discovered 427 rotten tests from 26 open-source Java projects hosted on GitHub. Using RTj, developers have an automated recommendation of the tests that need to be modified for improving the quality of the applications under test.