Combining Deep Reinforcement Learning with a Jerk-Bounded Trajectory Generator for Kinematically Constrained Motion Planning

TL;DR

This paper introduces a framework combining deep reinforcement learning with a jerk-bounded trajectory generator and low-level control to enhance safety, stability, and kinematic compliance in robotic motion planning, demonstrated on a complex heavy-duty manipulator.

Contribution

It presents a novel integrated approach that ensures safe, smooth, and reliable robotic motions by combining DRL with trajectory smoothing and safety constraints.

Findings

Enhanced safety and stability in robotic motion planning.

Successful application to a complex heavy-duty manipulator.

Improved kinematic compliance and motion smoothness.

Abstract

Deep reinforcement learning (DRL) is emerging as a promising method for adaptive robotic motion and complex task automation, effectively addressing the limitations of traditional control methods. However, ensuring safety throughout both the learning process and policy deployment remains a key challenge due to the risky exploration inherent in DRL, as well as the discrete nature of actions taken at intervals. These discontinuities, despite being part of a continuous action space, can lead to abrupt changes between successive actions, causing instability and unsafe intermediate states. To address these challenges, this paper proposes an integrated framework that combines DRL with a jerk-bounded trajectory generator (JBTG) and a robust low-level control strategy, significantly enhancing the safety, stability, and reliability of robotic manipulators. The low-level controller ensures the precise execution of DRL-generated commands, while the JBTG refines these motions to produce smooth, continuous trajectories that prevent abrupt or unsafe actions. The framework also includes pre-calculated safe velocity zones for smooth braking, preventing joint limit violations and ensuring compliance with kinematic constraints. This approach not only guarantees the robustness and safety of the robotic system but also optimizes motion control, making it suitable for practical applications. The effectiveness of the proposed framework is demonstrated through its application to a highly complex heavy-duty manipulator.