Human-Inspired Pavlovian and Instrumental Learning for Autonomous Agent Navigation

TL;DR

This paper introduces a biologically inspired hybrid reinforcement learning framework for autonomous navigation, combining Pavlovian and instrumental learning with Bayesian arbitration to enhance safety and learning speed in uncertain environments.

Contribution

The paper proposes a novel hybrid RL architecture inspired by neuroscience, integrating Pavlovian, MF, and MB components with adaptive arbitration for improved autonomous navigation.

Findings

Accelerates learning and convergence.

Enhances safety during exploration.

Reduces navigation in high-uncertainty areas.

Abstract

Autonomous agents operating in uncertain environments must balance fast responses with goal-directed planning. Classical MF RL often converges slowly and may induce unsafe exploration, whereas MB methods are computationally expensive and sensitive to model mismatch. This paper presents a human-inspired hybrid RL architecture integrating Pavlovian, Instrumental MF, and Instrumental MB components. Inspired by Pavlovian and Instrumental learning from neuroscience, the framework considers contextual radio cues, here intended as georeferenced environmental features acting as CS, to shape intrinsic value signals and bias decision-making. Learning is further modulated by internal motivational drives through a dedicated motivational signal. A Bayesian arbitration mechanism adaptively blends MF and MB estimates based on predicted reliability. Simulation results show that the hybrid approach accelerates learning, improves operational safety, and reduces navigation in high-uncertainty regions compared to standard RL baselines. Pavlovian conditioning promotes safer exploration and faster convergence, while arbitration enables a smooth transition from exploration to efficient, plan-driven exploitation. Overall, the results highlight the benefits of biologically inspired modularity for robust and adaptive autonomous systems under uncertainty.