FrUITeR: A Framework for Evaluating UI Test Reuse

TL;DR

FrUITeR is a framework that automates the evaluation of UI test reuse techniques, enabling scalable, reproducible comparisons across multiple apps, and reveals insights missed by prior manual assessments.

Contribution

We introduce FrUITeR, a novel framework for automatic, reproducible evaluation of UI test reuse techniques across a standardized benchmark.

Findings

Identified key factors influencing test reuse effectiveness.

Revealed limitations of existing test reuse methods.

Provided a large dataset of 11,917 test reuse cases.

Abstract

UI testing is tedious and time-consuming due to the manual effort required. Recent research has explored opportunities for reusing existing UI tests from an app to automatically generate new tests for other apps. However, the evaluation of such techniques currently remains manual, unscalable, and unreproducible, which can waste effort and impede progress in this emerging area. We introduce FrUITeR, a framework that automatically evaluates UI test reuse in a reproducible way. We apply FrUITeR to existing test-reuse techniques on a uniform benchmark we established, resulting in 11,917 test reuse cases from 20 apps. We report several key findings aimed at improving UI test reuse that are missed by existing work.