MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing

TL;DR

MQT Bench is a comprehensive, accessible benchmark suite for quantum software tools, supporting multiple abstraction levels and hardware architectures to improve evaluation, comparison, and reproducibility in quantum computing research.

Contribution

It introduces the first extensive, cross-level quantum benchmark suite with over 70,000 circuits, enhancing comparability and extendability for quantum software evaluation.

Findings

Over 70,000 benchmark circuits included

Supports four abstraction levels in quantum computing

Accessible via web interface and Python package

Abstract

Quantum software tools for a wide variety of design tasks on and across different levels of abstraction are crucial in order to eventually realize useful quantum applications. This requires practical and relevant benchmarks for new software tools to be empirically evaluated and compared to the current state of the art. Although benchmarks for specific design tasks are commonly available, the demand for an overarching cross-level benchmark suite has not yet been fully met and there is no mutual consolidation in how quantum software tools are evaluated thus far. In this work, we propose the MQT Bench benchmark suite (as part of the Munich Quantum Toolkit, MQT) based on four core traits: (1) cross-level support for different abstraction levels, (2) accessibility via an easy-to-use web interface (https://www.cda.cit.tum.de/mqtbench) and a Python package, (3) provision of a broad selection of benchmarks to facilitate generalizability, as well as (4) extendability to future algorithms, gate-sets, and hardware architectures. By comprising more than 70,000 benchmark circuits ranging from 2 to 130 qubits on four abstraction levels, MQT Bench presents a first step towards benchmarking different abstraction levels with a single benchmark suite to increase comparability, reproducibility, and transparency.