ManiSkill-ViTac 2025: Challenge on Manipulation Skill Learning With Vision and Tactile Sensing

TL;DR

The ManiSkill-ViTac 2025 challenge advances robotic manipulation by integrating tactile and visual sensing, with multiple tracks to foster innovations in sensor design and sensor data fusion for complex tasks.

Contribution

This challenge introduces new tracks focusing on tactile manipulation, vision-tactile fusion, and sensor structure design, expanding the scope of manipulation skill learning competitions.

Findings

Enhanced manipulation performance through sensor fusion

Development of novel tactile sensor structures

Progress in real-world robotic manipulation tasks

Abstract

This article introduces the ManiSkill-ViTac Challenge 2025, which focuses on learning contact-rich manipulation skills using both tactile and visual sensing. Expanding upon the 2024 challenge, ManiSkill-ViTac 2025 includes 3 independent tracks: tactile manipulation, tactile-vision fusion manipulation, and tactile sensor structure design. The challenge aims to push the boundaries of robotic manipulation skills, emphasizing the integration of tactile and visual data to enhance performance in complex, real-world tasks. Participants will be evaluated using standardized metrics across both simulated and real-world environments, spurring innovations in sensor design and significantly advancing the field of vision-tactile fusion in robotics.