Learning Control Policies for Fall prevention and safety in bipedal locomotion

TL;DR

This paper develops deep reinforcement learning algorithms to enable bipedal robots and assistive devices to recover from perturbations and fall safely, enhancing stability and safety in locomotion.

Contribution

It introduces novel DRL-based control policies for fall prevention and safe falling in humanoid robots and assistive devices, addressing limitations of traditional model-based methods.

Findings

Effective control policies learned for fall recovery.

Improved safety in bipedal locomotion.

Robustness to dynamic changes demonstrated.

Abstract

The ability to recover from an unexpected external perturbation is a fundamental motor skill in bipedal locomotion. An effective response includes the ability to not just recover balance and maintain stability but also to fall in a safe manner when balance recovery is physically infeasible. For robots associated with bipedal locomotion, such as humanoid robots and assistive robotic devices that aid humans in walking, designing controllers which can provide this stability and safety can prevent damage to robots or prevent injury related medical costs. This is a challenging task because it involves generating highly dynamic motion for a high-dimensional, non-linear and under-actuated system with contacts. Despite prior advancements in using model-based and optimization methods, challenges such as requirement of extensive domain knowledge, relatively large computational time and limited robustness to changes in dynamics still make this an open problem. In this thesis, to address these issues we develop learning-based algorithms capable of synthesizing push recovery control policies for two different kinds of robots : Humanoid robots and assistive robotic devices that assist in bipedal locomotion. Our work can be branched into two closely related directions : 1) Learning safe falling and fall prevention strategies for humanoid robots and 2) Learning fall prevention strategies for humans using a robotic assistive devices. To achieve this, we introduce a set of Deep Reinforcement Learning (DRL) algorithms to learn control policies that improve safety while using these robots.