Quantum software experiments: A reporting and laboratory package structure guidelines

TL;DR

This paper proposes standardized reporting and laboratory package guidelines to improve the reproducibility and reliability of quantum software experiments, addressing a current lack of such standards in the field.

Contribution

It introduces tailored guidelines and a structured framework for quantum software experiments, adapting existing software engineering standards to the quantum context.

Findings

Identified absence of standardized guidelines in quantum software experiments

Validated the proposed guidelines through review of 11 relevant works

Highlighted opportunities for improving reproducibility and reporting quality

Abstract

Background. In the realm of software engineering, there are widely accepted guidelines for reporting and creating laboratory packages. Unfortunately, the landscape differs considerably in the emerging field of quantum computing. To the best of our knowledge, no standardized guidelines exist for describing experiments or outlining the necessary structures for quantum software laboratory packages. Aims. This paper endeavors to enhance the replicability and verifiability of quantum software experiments. Method. This objective is pursued through the proposition of guidelines for reporting and the delineation of a structure for laboratory packages tailored to quantum computing experiments. Specifically, we advocate for an extension and adaption of established guidelines in experimental software engineering, integrating novel elements to address the specific requirements of quantum software engineering. Results. In validating the utility and effectiveness of the proposed guidelines, we conducted a review encompassing 11 works (5 focusing on reporting guidelines and 6 on laboratory packages). In particular, this review highlighted the absence of standardized guidelines and structure of laboratory packages for quantum software experiments. Conclusions. Our assessment revealed gaps in information and opportunities for enhancement within the evaluated papers and laboratory packages. Our proposal contributes to the advancement of quantum software engineering research, taking a fundamental step toward fostering rigorous and reliable scientific research in this emerging paradigm.