Neural Contractive Dynamical Systems
Hadi Beik-Mohammadi, S{\o}ren Hauberg, Georgios Arvanitidis, Nadia, Figueroa, Gerhard Neumann, and Leonel Rozo

TL;DR
This paper introduces a neural architecture for learning contractive dynamical systems that guarantees global stability, scales to high dimensions, and extends to rotation groups, enabling safer autonomous robot control.
Contribution
The paper presents a novel neural network design that ensures contraction and stability in learned dynamics, including a scalable variational autoencoder variant and an extension to Lie groups.
Findings
Outperforms state-of-the-art in encoding dynamics accurately
Provides strong global stability guarantees
Enables obstacle avoidance in learned systems
Abstract
Stability guarantees are crucial when ensuring a fully autonomous robot does not take undesirable or potentially harmful actions. Unfortunately, global stability guarantees are hard to provide in dynamical systems learned from data, especially when the learned dynamics are governed by neural networks. We propose a novel methodology to learn neural contractive dynamical systems, where our neural architecture ensures contraction, and hence, global stability. To efficiently scale the method to high-dimensional dynamical systems, we develop a variant of the variational autoencoder that learns dynamics in a low-dimensional latent representation space while retaining contractive stability after decoding. We further extend our approach to learning contractive systems on the Lie group of rotations to account for full-pose end-effector dynamic motions. The result is the first highly flexible…
Peer Reviews
Decision·ICLR 2024 spotlight
See above.
See above.
The paper has several strengths. * The idea of learning a low dimensional latent space embedding of the dynamics is interesting and novel, with a variety of interesting potential applications * The construction of the VAE ensures that the contractivity is invariant to the mapping to the latent space (and vice versa) * The proposed framework is extended to a variety of scenarios, including dynamics over Lie groups ($SO(3)$) and obstacle avoidance * The paper itself is, generally speaking, well w
There are a few weaknesses. * It would be nice to have the invariance of the contractivity stated formally. * In the discussion section (page 9), it is mentioned that the choice of integration scheme can siginificantly affect the behaviour of the learned model. This requires further discussion. For instance, how significantly does the computation time affect the performance of the model? Is there a choice of integrator that doesn't require adaptive step-sizes (perhaps a symplectic integrator)?
### Originality and Significance This is the first work to my knowledge that endows neural network based dynamics modeling with guaranteed contractive stability, which is, as the authors point out, important to robotics as people are trying to take advantage of the modeling capacity of neural networks. The conservative and non-diverging extrapolation that comes with the contractiveness enabled by this work could also benefit neural modeling of other dynamical systems apart from robotics, as the
1. Some implementation details are missing and the codes are not available. See more in the Questions section. 2. Limitation of baseline method choices: The baselines compared to are all focused on asymptotic stability guarantees. While these are the most relevant methods for comparison, it would be interesting to see how imitation learning methods without any stability guarantee works on the tasks, to demonstrate the necessity of stability guarantee.
Videos
Taxonomy
TopicsModel Reduction and Neural Networks · Robot Manipulation and Learning · Control and Stability of Dynamical Systems
