QuAS: Quantum Application Score for benchmarking the utility of quantum computers

TL;DR

This paper introduces QuAS, a comprehensive scoring method that evaluates the practical utility of quantum computers by integrating existing metrics, and demonstrates its application on various hardware and simulators.

Contribution

The paper presents QuAS, a novel holistic metric for benchmarking quantum computers' utility, combining features of previous metrics like QPack and Q-score.

Findings

QuAS effectively differentiates quantum hardware performance.

The metric provides a practical utility assessment across platforms.

Results show consistent evaluation of quantum devices and simulators.

Abstract

Benchmarking quantum computers helps to quantify them and bringing the technology to the market. Various application-level metrics exist to benchmark a quantum device at an application level. This paper presents a revised holistic scoring method called the Quantum Application Score (QuAS) incorporating strong points of previous metrics, such as QPack and the Q-score. We discuss how to integrate both and thereby obtain an application-level metric that better quantifies the practical utility of quantum computers. We evaluate the new metric on different hardware platforms such as D-Wave and IBM as well as quantum simulators of Quantum Inspire and Rigetti.