QBugs: A Collection of Reproducible Bugs in Quantum Algorithms and a Supporting Infrastructure to Enable Controlled Quantum Software Testing and Debugging Experiments

TL;DR

QBugs is a proposed benchmark and infrastructure designed to improve reproducibility and comparability in quantum software engineering research, addressing the current lack of standardized experimental subjects.

Contribution

The paper introduces QBugs, the first benchmark for quantum software engineering, along with an infrastructure to facilitate reproducible experiments and evaluations.

Findings

Proposes QBugs as a new benchmark for quantum software engineering

Provides infrastructure to support reproducible quantum experiments

Aims to standardize evaluation and comparison in the field

Abstract

Reproducibility and comparability of empirical results are at the core tenet of the scientific method in any scientific field. To ease reproducibility of empirical studies, several benchmarks in software engineering research, such as Defects4J, have been developed and widely used. For quantum software engineering research, however, no benchmark has been established yet. In this position paper, we propose a new benchmark -- named QBugs -- which will provide experimental subjects and an experimental infrastructure to ease the evaluation of new research and the reproducibility of previously published results on quantum software engineering.