Mind the Gap: Learning Implicit Impedance in Visuomotor Policies via Intent-Execution Mismatch

TL;DR

This paper introduces a novel learning framework for visuomotor policies that leverages intent-execution mismatch to implicitly encode impedance control, enabling robust contact-rich manipulation without explicit force sensors.

Contribution

The work proposes a Dual-State Conditioning approach that learns implicit impedance control from intent-execution mismatch, improving robustness in contact-rich tasks without explicit force sensing.

Findings

Outperforms standard behavior cloning in contact-rich tasks

Enables implicit force perception without explicit sensors

Achieves robust dynamic tracking and manipulation

Abstract

Teleoperation inherently relies on the human operator acting as a closed-loop controller to actively compensate for hardware imperfections, including latency, mechanical friction, and lack of explicit force feedback. Standard Behavior Cloning (BC), by mimicking the robot's executed trajectory, fundamentally ignores this compensatory mechanism. In this work, we propose a Dual-State Conditioning framework that shifts the learning objective to "Intent Cloning" (master command). We posit that the Intent-Execution Mismatch, the discrepancy between master command and slave response, is not noise, but a critical signal that physically encodes implicit interaction forces and algorithmically reveals the operator's strategy for overcoming system dynamics. By predicting the master intent, our policy learns to generate a "virtual equilibrium point", effectively realizing implicit impedance control. Furthermore, by explicitly conditioning on the history of this mismatch, the model performs implicit system identification, perceiving tracking errors as external forces to close the control loop. To bridge the temporal gap caused by inference latency, we further formulate the policy as a trajectory inpainter to ensure continuous control. We validate our approach on a sensorless, low-cost bi-manual setup. Empirical results across tasks requiring contact-rich manipulation and dynamic tracking reveal a decisive gap: while standard execution-cloning fails due to the inability to overcome contact stiffness and tracking lag, our mismatch-aware approach achieves robust success. This presents a minimalist behavior cloning framework for low-cost hardware, enabling force perception and dynamic compensation without relying on explicit force sensing. Videos are available on the \href{https://xucj98.github.io/mind-the-gap-page/}{project page}.