Theoretical Closed-loop Stability Bounds for Dynamical System Coupled with Diffusion Policies

TL;DR

This paper develops a theoretical framework for analyzing the stability of closed-loop systems employing diffusion policies, enabling faster decision-making in robotic control by partially coupling plant and denoising dynamics.

Contribution

It introduces a novel stability analysis framework for coupled plant and diffusion denoising dynamics, facilitating real-time application of diffusion policies in robotics.

Findings

Derived theoretical bounds on system stability with coupled dynamics.

Proposed a metric to predict controller stability based on demonstration variance.

Enables partial denoising for faster decision-making in diffusion-based control.

Abstract

Diffusion Policy has shown great performance in robotic manipulation tasks under stochastic perturbations, due to its ability to model multimodal action distributions. Nonetheless, its reliance on a computationally expensive reverse-time diffusion (denoising) process, for action inference, makes it challenging to use for real-time applications where quick decision-making is mandatory. This work studies the possibility of conducting the denoising process only partially before executing an action, allowing the plant to evolve according to its dynamics in parallel to the reverse-time diffusion dynamics ongoing on the computer. In a classical diffusion policy setting, the plant dynamics are usually slow and the two dynamical processes are uncoupled. Here, we investigate theoretical bounds on the stability of closed-loop systems using diffusion policies when the plant dynamics and the denoising dynamics are coupled. The contribution of this work gives a framework for faster imitation learning and a metric that yields if a controller will be stable based on the variance of the demonstrations.