Benchmarking Quantum Computers and the Impact of Quantum Noise

TL;DR

This paper discusses the complexities of benchmarking quantum computers, emphasizing the influence of quantum noise and the need for careful selection of benchmarks and metrics to accurately assess performance.

Contribution

It provides a computer architecture perspective on quantum benchmarking and highlights the challenges posed by quantum noise through numerical simulations.

Findings

Quantum noise significantly affects quantum computer performance.

Benchmarking quantum systems is more complex than classical systems.

Simulations reveal the difficulty in accurately modeling quantum noise.

Abstract

Benchmarking is how the performance of a computing system is determined. Surprisingly, even for classical computers this is not a straightforward process. One must choose the appropriate benchmark and metrics to extract meaningful results. Different benchmarks test the system in different ways and each individual metric may or may not be of interest. Choosing the appropriate approach is tricky. The situation is even more open ended for quantum computers, where there is a wider range of hardware, fewer established guidelines, and additional complicating factors. Notably, quantum noise significantly impacts performance and is difficult to model accurately. Here, we discuss benchmarking of quantum computers from a computer architecture perspective and provide numerical simulations highlighting challenges which suggest caution.