QMutBench: A Dataset of Quantum Circuit Mutants

TL;DR

QMutBench is a comprehensive dataset of over 700,000 quantum circuit mutants designed to facilitate benchmarking and development of quantum software testing techniques.

Contribution

It introduces a large, accessible dataset of quantum circuit mutants with customizable selection criteria for testing and benchmarking quantum software testing methods.

Findings

Provides over 700,000 quantum circuit mutants for testing.

Accessible online with customizable selection parameters.

Enables comparison and development of quantum testing techniques.

Abstract

Quantum software testing has attracted interest in recent years, prompting the development of various techniques to automate the testing of quantum software. These techniques generate test cases that must be assessed for their effectiveness in detecting faults. Such an assessment requires benchmarks of faulty programs. However, there is a lack of benchmarks containing faults. In this data showcase, we propose QMutBench, a dataset that contains over 700,000 quantum circuit mutants representing different faults. The dataset is accessible via an online interface with selection criteria, such as the original quantum circuit(s) from which mutants are generated, the desired survival rate of the selected mutants, and other mutation characteristics (e.g., the type of faulty quantum gate). QMutBench provides quantum software developers and testers with an accessible online dataset to obtain benchmarks of mutants necessary to assess either the quality of the test cases generated by their testing technique or to compare different testing techniques. It also enables the development of new mutation-guided quantum software testing techniques.