Q-SpiRL: Quantum Spiking Reinforcement Learning for Adaptive Robot Navigation

TL;DR

Q-SpiRL introduces a quantum spiking reinforcement learning framework for adaptive robot navigation, demonstrating superior performance and real-device feasibility in dynamic environments.

Contribution

The paper develops and evaluates a novel quantum-enhanced spiking neural network architecture for robot navigation, integrating spike-based processing with quantum features.

Findings

QSNN achieves up to 99% success rate in complex environments.

Quantum-enhanced models outperform classical counterparts in efficiency and stability.

Hybrid quantum-classical implementation is feasible on real quantum hardware.

Abstract

Adaptive robot navigation in dynamic environments requires policies that can reach the target reliably while producing efficient and stable trajectories. This paper presents Q-SpiRL, a quantum spiking reinforcement learning framework for obstacle-aware robot navigation. The framework develops and evaluates five agent families: tabular Q-learning, classical MLP, classical SNN, quantum-enhanced MLP (QMLP), and quantum-enhanced spiking neural network (QSNN). While all models are implemented under a unified training and evaluation pipeline, the QSNN is the central architecture of interest, as it combines spike-based temporal processing with variational quantum feature transformation. Experiments are conducted across three grid-world environments of increasing size, namely 20x20, 30x30, and 40x40, with both static and dynamic obstacles. Performance is assessed using success rate, success-weighted path length, path length, and turn rate under deterministic inference. Results show that QSNN achieves the strongest overall trade-off between task completion, trajectory efficiency, and motion smoothness, reaching up to 99% success rate while maintaining high path efficiency in the most challenging setting. Execution on IBM quantum hardware further demonstrates the feasibility of deploying the proposed hybrid policy under real-device conditions.