Group-Theoretic Reinforcement Learning of Dynamical Decoupling Sequences

TL;DR

This paper introduces a reinforcement learning approach using a novel group-theoretic action set to design dynamical decoupling pulse sequences that effectively minimize qubit dephasing without prior noise spectrum knowledge.

Contribution

The work presents a new RL-based method with a Thompson's group F action set for optimizing pulse sequences, enabling real-time, model-free learning of dynamical decoupling strategies.

Findings

RL agent learns effective pulse sequences for dephasing mitigation

Method does not require explicit noise spectrum knowledge

Applicable to broad class of decision problems with sequence states

Abstract

Dynamical decoupling seeks to mitigate phase decoherence in qubits by applying a carefully designed sequence of effectively instantaneous electromagnetic pulses. Although analytic solutions exist for pulse timings that are optimal under specific noise regimes, identifying the optimal timings for a realistic noise spectrum remains challenging. We propose a reinforcement learning (RL)-based method for designing pulse sequences on qubits. Our novel action set enables the RL agent to efficiently navigate this inherently non-convex optimization landscape. The action set, derived from Thompson's group $F$, is applicable to a broad class of sequential decision problems whose states can be represented as bounded sequences. We demonstrate that our RL agent can learn pulse sequences that minimize dephasing without requiring explicit knowledge of the underlying noise spectrum. This work opens the possibility for real-time learning of optimal dynamical decoupling sequences on qubits which are dephasing-limited. The model-free nature of our algorithm suggests that the agent may ultimately learn optimal pulse sequences even in the presence of unmodeled physical effects, such as pulse errors or non-Gaussian noise.