Learning and Inference of Dexterous Grasps for Novel Objects with Underactuated Hands

TL;DR

This paper presents a novel learning approach for dexterous grasps with underactuated hands, modeling contact interactions implicitly and enabling transfer of grasp strategies to new objects with high success.

Contribution

It introduces a new method that models motor commands leading to equilibrium states, allowing transfer of grasps to novel objects for underactuated hands.

Findings

Achieved 80% success rate on unseen objects

Learned from nine training grasps on three objects

Transferred grasp strategies to significantly different objects

Abstract

Recent advances have been made in learning of grasps for fully actuated hands. A typical approach learns the target locations of finger links on the object. When a new object must be grasped, new finger locations are generated, and a collision free reach-to-grasp trajectory is planned. This assumes a collision free trajectory to the final grasp. This is not possible with underactuated hands, which cannot be guaranteed to avoid contact, and in fact exploit contacts with the object during grasping, so as to reach an equilibrium state in which the object is held securely. Unfortunately, these contact interactions are i) not directly controllable, and ii) hard to monitor during a real grasp. We overcome these problems so as to permit learning of transferrable grasps for underactuated hands. We make two main technical innovations. First, we model contact interactions during the grasp implicitly. We do this by modelling motor commands that lead reliably to the equilibrium state, rather than modelling contact changes themselves. This alters our reach-to-grasp model. Second, we extend our contact model learning algorithm to work with multiple training examples for each grasp type. This requires the ability to learn which parts of the hand reliably interact with the object during a particular grasp. Our approach learns from a rigid body simulation. This enables us to learn how to approach the object and close the underactuated hand from a variety of poses. From nine training grasps on three objects the method transferred grasps to previously unseen, novel objects, that differ significantly from the training objects, with an 80% success rate.