Neural Approaches to Co-Optimization in Robotics

TL;DR

This paper presents neural methods for end-to-end co-optimization of robotic systems, including physical design, perception, and control, to improve task performance through deep learning and reinforcement learning techniques.

Contribution

It introduces a deep learning framework for joint optimization of robot components and controllers, including discrete morphological parameters, for enhanced task efficiency.

Findings

Deep learning approach improves beacon placement and localization accuracy.

Multi-task reinforcement learning enables efficient joint optimization of design and control.

Optimized soft robots demonstrate practical deployment capabilities.

Abstract

Robots and intelligent systems that sense or interact with the world are increasingly being used to automate a wide array of tasks. The ability of these systems to complete these tasks depends on a large range of technologies such as the mechanical and electrical parts that make up the physical body of the robot and its sensors, perception algorithms to perceive the environment, and planning and control algorithms to produce meaningful actions. Therefore, it is often necessary to consider the interactions between these components when designing an embodied system. This thesis explores work on the task-driven co-optimization of robotics systems in an end-to-end manner, simultaneously optimizing the physical components of the system with inference or control algorithms directly for task performance. We start by considering the problem of optimizing a beacon-based localization system directly for localization accuracy. Designing such a system involves placing beacons throughout the environment and inferring location from sensor readings. In our work, we develop a deep learning approach to optimize both beacon placement and location inference directly for localization accuracy. We then turn our attention to the related problem of task-driven optimization of robots and their controllers. In our work, we start by proposing a data-efficient algorithm based on multi-task reinforcement learning. Our approach efficiently optimizes both physical design and control parameters directly for task performance by leveraging a design-conditioned controller capable of generalizing over the space of physical designs. We then follow this up with an extension to allow for the optimization over discrete morphological parameters such as the number and configuration of limbs. Finally, we conclude by exploring the fabrication and deployment of optimized soft robots.