Robust optimization for quantum reinforcement learning control using partial observations

TL;DR

This paper introduces a robust quantum reinforcement learning control method that uses partial observations, making it feasible for near-term quantum devices with noise and measurement limitations, and achieves high performance despite uncertainties.

Contribution

It proposes a novel partial observation-based control scheme for quantum reinforcement learning, suitable for noisy, real-world quantum devices, outperforming traditional full-observation methods.

Findings

High-fidelity state control achieved under noise levels comparable to control amplitude

Effective optimization for QAOA with noisy control Hamiltonian

Comparable or better performance than full observation methods

Abstract

The current quantum reinforcement learning control models often assume that the quantum states are known a priori for control optimization. However, full observation of quantum state is experimentally infeasible due to the exponential scaling of the number of required quantum measurements on the number of qubits. In this paper, we investigate a robust reinforcement learning method using partial observations to overcome this difficulty. This control scheme is compatible with near-term quantum devices, where the noise is prevalent and predetermining the dynamics of quantum state is practically impossible. We show that this simplified control scheme can achieve similar or even better performance when compared to the conventional methods relying on full observation. We demonstrate the effectiveness of this scheme on examples of quantum state control and quantum approximate optimization algorithm. It has been shown that high-fidelity state control can be achieved even if the noise amplitude is at the same level as the control amplitude. Besides, an acceptable level of optimization accuracy can be achieved for QAOA with noisy control Hamiltonian. This robust control optimization model can be trained to compensate the uncertainties in practical quantum computing.