TL;DR
ReproBreak is a new dataset of 449 reproducible locator breaks in web GUI tests, created by analyzing 359 open-source repositories, to aid research on test fragility and repair techniques.
Contribution
The paper introduces ReproBreak, the first large-scale dataset of reproducible locator breaks in web application GUI tests, with scripts for automated reproduction.
Findings
Identified 449 locator breaks from 359 repositories.
Provided scripts for automated reproduction of locator breaks.
Dataset supports research on test robustness and repair techniques.
Abstract
Automated GUI testing frameworks such as Cypress and Playwright rely on locators to find and interact with web elements. A locator break occurs when a structural change in the application under test causes a locator to no longer find its target element, resulting in test breakages even when the underlying functionality remains unchanged. Despite its impact on test maintenance, no dataset exists to evaluate locator fragility in Cypress and Playwright at scale. In this paper, we present ReproBreak, a dataset of reproducible locator breaks in web application GUI tests. We analyzed 359 open-source repositories to identify commits that contain locator changes. To confirm whether these changes are indeed locator breaks, we reproduced them in the top 4 projects with the largest number of locator changes and found 449 locator breaks, which are provided in the dataset along with scripts for…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
