Exploring the Role of Electro-Tactile and Kinesthetic Feedback in Telemanipulation Task

TL;DR

This paper introduces a multimodal haptic feedback system combining kinesthetic and cutaneous stimuli to improve precision in telemanipulation tasks involving deformable objects, significantly enhancing dosing accuracy and speed.

Contribution

It presents a novel telemanipulation system providing combined kinesthetic and cutaneous feedback, improving dexterous manipulation of soft objects compared to traditional visual or kinesthetic-only feedback.

Findings

66% reduction in dosing error

18% decrease in task time

Enhanced manipulation accuracy with multimodal feedback

Abstract

Teleoperation of robotic systems for precise and delicate object grasping requires high-fidelity haptic feedback to obtain comprehensive real-time information about the grasp. In such cases, the most common approach is to use kinesthetic feedback. However, a single contact point information is insufficient to detect the dynamically changing shape of soft objects. This paper proposes a novel telemanipulation system that provides kinesthetic and cutaneous stimuli to the user's hand to achieve accurate liquid dispensing by dexterously manipulating the deformable object (i.e., pipette). The experimental results revealed that the proposed approach to provide the user with multimodal haptic feedback considerably improves the quality of dosing with a remote pipette. Compared with pure visual feedback, the relative dosing error decreased by 66\% and task execution time decreased by 18\% when users manipulated the deformable pipette with a multimodal haptic interface in combination with visual feedback. The proposed technology can be potentially implemented in delicate dosing procedures during the antibody tests for COVID-19, chemical experiments, operation with organic materials, and telesurgery.