Embodiment dictates learnability in neural controllers
Joshua Powers, Ryan Grindle, Sam Kriegman, Lapo Frati, Nick Cheney,, Josh Bongard

TL;DR
This paper shows how the physical embodiment of robots, especially sensor placement, influences the ease of learning multiple tasks by affecting the loss landscape and controller overlap, thereby impacting catastrophic forgetting.
Contribution
It introduces the novel insight that robot embodiment, specifically sensor placement, can shape the loss landscape and influence learnability and forgetting in neural controllers.
Findings
Sensor placement alters the loss landscape.
Embodiment affects the overlap of task-specific controllers.
Design choices can mitigate catastrophic forgetting.
Abstract
Catastrophic forgetting continues to severely restrict the learnability of controllers suitable for multiple task environments. Efforts to combat catastrophic forgetting reported in the literature to date have focused on how control systems can be updated more rapidly, hastening their adjustment from good initial settings to new environments, or more circumspectly, suppressing their ability to overfit to any one environment. When using robots, the environment includes the robot's own body, its shape and material properties, and how its actuators and sensors are distributed along its mechanical structure. Here we demonstrate for the first time how one such design decision (sensor placement) can alter the landscape of the loss function itself, either expanding or shrinking the weight manifolds containing suitable controllers for each individual task, thus increasing or decreasing their…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDomain Adaptation and Few-Shot Learning · Reinforcement Learning in Robotics · Robot Manipulation and Learning
