A Versatile Agent for Fast Learning from Human Instructors

TL;DR

This paper introduces a versatile robotic agent that quickly learns from minimal human demonstrations by utilizing a pre-trained policy pool, enabling efficient, flexible, and lifelong learning in complex tasks.

Contribution

It proposes a hierarchical framework that interprets human demonstrations to select and sequence pre-trained skills, facilitating fast one-shot learning and lifelong adaptability.

Findings

Successfully learned complex multi-stage tasks from a single demonstration

Demonstrated lifelong learning capabilities in a simulated environment

Showed potential for immediate mastery of robotics skills from minimal input

Abstract

In recent years, a myriad of superlative works on intelligent robotics policies have been done, thanks to advances in machine learning. However, inefficiency and lack of transfer ability hindered algorithms from pragmatic applications, especially in human-robot collaboration, when few-shot fast learning and high flexibility become a wherewithal. To surmount this obstacle, we refer to a "Policy Pool", containing pre-trained skills that can be easily accessed and reused. An agent is employed to govern the "Policy Pool" by unfolding requisite skills in a flexible sequence, contingent on task specific predilection. This predilection can be automatically interpreted from one or few human expert demonstrations. Under this hierarchical setting, our algorithm is able to pick up a sparse-reward, multi-stage knack with only one demonstration in a Mini-Grid environment, showing the potential for instantly mastering complex robotics skills from human instructors. Additionally, the innate quality of our algorithm also allows for lifelong learning, making it a versatile agent.