TACO: Learning Task Decomposition via Temporal Alignment for Control

TL;DR

TACO introduces a weakly supervised, domain-agnostic method for learning task decomposition and sub-policies from demonstrations using temporal alignment, reducing annotation effort while maintaining high performance.

Contribution

It presents a novel approach that aligns task sketches with demonstrations to learn sub-policies without extensive supervision or domain knowledge.

Findings

Performs comparably to fully supervised methods

Requires significantly less annotation effort

Effective on multiple domains including image-based robot control

Abstract

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each policy from different high-level tasks and compose them to perform novel ones. Existing approaches to modular LfD focus either on learning a single high-level task or depend on domain knowledge and temporal segmentation. In contrast, we propose a weakly supervised, domain-agnostic approach based on task sketches, which include only the sequence of sub-tasks performed in each demonstration. Our approach simultaneously aligns the sketches with the observed demonstrations and learns the required sub-policies. This improves generalisation in comparison to separate optimisation procedures. We evaluate the approach on multiple domains, including a simulated 3D robot arm control task using purely image-based observations. The results show that our approach performs commensurately with fully supervised approaches, while requiring significantly less annotation effort.