Learning Deep Robotic Skills on Riemannian manifolds

TL;DR

This paper introduces RiemannianFlow, a deep generative model enabling robots to learn complex, stable skills on Riemannian manifolds like SPD matrices and quaternions, ensuring geometric constraints are preserved during learning.

Contribution

The paper presents RiemannianFlow, a novel approach extending deep generative models to Riemannian data, maintaining stability and geometric constraints in robotic skill learning.

Findings

RiemannianFlow effectively learns manifold-based data patterns.

Model stability is unaffected by hyperparameter variations.

Significant accuracy improvements up to 27.6% with proper hyperparameter tuning.

Abstract

In this paper, we propose RiemannianFlow, a deep generative model that allows robots to learn complex and stable skills evolving on Riemannian manifolds. Examples of Riemannian data in robotics include stiffness (symmetric and positive definite matrix (SPD)) and orientation (unit quaternion (UQ)) trajectories. For Riemannian data, unlike Euclidean ones, different dimensions are interconnected by geometric constraints which have to be properly considered during the learning process. Using distance preserving mappings, our approach transfers the data between their original manifold and the tangent space, realizing the removing and re-fulfilling of the geometric constraints. This allows to extend existing frameworks to learn stable skills from Riemannian data while guaranteeing the stability of the learning results. The ability of RiemannianFlow to learn various data patterns and the stability of the learned models are experimentally shown on a dataset of manifold motions. Further, we analyze from different perspectives the robustness of the model with different hyperparameter combinations. It turns out that the model's stability is not affected by different hyperparameters, a proper combination of the hyperparameters leads to a significant improvement (up to 27.6%) of the model accuracy. Last, we show the effectiveness of RiemannianFlow in a real peg-in-hole (PiH) task where we need to generate stable and consistent position and orientation trajectories for the robot starting from different initial poses.