TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Types
Yuhao Lin, Yi-Lin Wei, Haoran Liao, Mu Lin, Chengyi Xing, Hao Li, Dandan Zhang, Mark Cutkosky, Wei-Shi Zheng

TL;DR
TypeTele introduces a type-guided approach to dexterous teleoperation, enabling robotic hands to perform complex actions beyond human-like motions by leveraging manipulation types and an intelligent retrieval system.
Contribution
It presents a novel system that incorporates manipulation types and a large language model-assisted retrieval to enhance dexterous teleoperation capabilities.
Findings
Higher success rates in complex manipulation tasks
Effective use of manipulation types for task-specific actions
Demonstrated advantages over traditional hand retargeting methods
Abstract
Dexterous teleoperation plays a crucial role in robotic manipulation for real-world data collection and remote robot control. Previous dexterous teleoperation mostly relies on hand retargeting to closely mimic human hand postures. However, these approaches may fail to fully leverage the inherent dexterity of dexterous hands, which can execute unique actions through their structural advantages compared to human hands. To address this limitation, we propose TypeTele, a type-guided dexterous teleoperation system, which enables dexterous hands to perform actions that are not constrained by human motion patterns. This is achieved by introducing dexterous manipulation types into the teleoperation system, allowing operators to employ appropriate types to complete specific tasks. To support this system, we build an extensible dexterous manipulation type library to cover comprehensive dexterous…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRobot Manipulation and Learning · Teleoperation and Haptic Systems · Social Robot Interaction and HRI
