# Assessing the Quality of the Steps to Reproduce in Bug Reports

## TL;DR

This paper introduces Euler, an automated approach for evaluating and improving the quality of steps to reproduce in bug reports, aiming to reduce manual effort in bug triage.

## Contribution

Euler is a novel method that automatically assesses and provides feedback on the quality of steps to reproduce in bug reports, enhancing bug report clarity.

## Key findings

- Euler correctly identified 98% of existing steps to reproduce
- Euler identified 58% of missing steps
- 73% of Euler's quality annotations are correct

## Abstract

A major problem with user-written bug reports, indicated by developers and documented by researchers, is the (lack of high) quality of the reported steps to reproduce the bugs. Low-quality steps to reproduce lead to excessive manual effort spent on bug triage and resolution. This paper proposes Euler, an approach that automatically identifies and assesses the quality of the steps to reproduce in a bug report, providing feedback to the reporters, which they can use to improve the bug report. The feedback provided by Euler was assessed by external evaluators and the results indicate that Euler correctly identified 98% of the existing steps to reproduce and 58% of the missing ones, while 73% of its quality annotations are correct.