Improving Tactile Gesture Recognition with Optical Flow

TL;DR

This paper enhances tactile gesture recognition accuracy by incorporating optical flow to highlight contact dynamics, enabling better differentiation of similar gestures in human-robot interaction.

Contribution

It introduces a method to improve gesture classification by adding optical flow to tactile images, emphasizing contact dynamics for better recognition.

Findings

9% improvement in gesture classification accuracy

Optical flow helps distinguish similar gestures

Enhanced tactile gesture recognition performance

Abstract

Tactile gesture recognition systems play a crucial role in Human-Robot Interaction (HRI) by enabling intuitive communication between humans and robots. The literature mainly addresses this problem by applying machine learning techniques to classify sequences of tactile images encoding the pressure distribution generated when executing the gestures. However, some gestures can be hard to differentiate based on the information provided by tactile images alone. In this paper, we present a simple yet effective way to improve the accuracy of a gesture recognition classifier. Our approach focuses solely on processing the tactile images used as input by the classifier. In particular, we propose to explicitly highlight the dynamics of the contact in the tactile image by computing the dense optical flow. This additional information makes it easier to distinguish between gestures that produce similar tactile images but exhibit different contact dynamics. We validate the proposed approach in a tactile gesture recognition task, showing that a classifier trained on tactile images augmented with optical flow information achieved a 9% improvement in gesture classification accuracy compared to one trained on standard tactile images.