MeMo: Meaningful, Modular Controllers via Noise Injection

TL;DR

MeMo introduces a framework for creating modular controllers from a single robot, enabling quick adaptation to new robots and tasks by reusing learned modules, thus improving training efficiency.

Contribution

The paper presents a novel modularity objective and noise injection method to learn meaningful, reusable robot controllers, facilitating rapid transfer to new robot structures and tasks.

Findings

MeMo outperforms graph neural network and Transformer baselines in transfer tasks.

Modules enable efficient structure and task transfer.

Framework improves training efficiency in robot control learning.

Abstract

Robots are often built from standardized assemblies, (e.g. arms, legs, or fingers), but each robot must be trained from scratch to control all the actuators of all the parts together. In this paper we demonstrate a new approach that takes a single robot and its controller as input and produces a set of modular controllers for each of these assemblies such that when a new robot is built from the same parts, its control can be quickly learned by reusing the modular controllers. We achieve this with a framework called MeMo which learns (Me)aningful, (Mo)dular controllers. Specifically, we propose a novel modularity objective to learn an appropriate division of labor among the modules. We demonstrate that this objective can be optimized simultaneously with standard behavior cloning loss via noise injection. We benchmark our framework in locomotion and grasping environments on simple to complex robot morphology transfer. We also show that the modules help in task transfer. On both structure and task transfer, MeMo achieves improved training efficiency to graph neural network and Transformer baselines.