Real-Time Gesture Recognition with Virtual Glove Markers

TL;DR

This paper introduces a real-time gesture recognition system using virtual glove markers and deep learning, aiming to improve natural human-computer interaction in applications like telepresence and rehabilitation.

Contribution

It presents a novel computer vision-based approach utilizing virtual glove markers combined with deep learning for real-time gesture recognition.

Findings

Effective real-time gesture recognition demonstrated

Suitable for telepresence and rehabilitation applications

High accuracy and responsiveness achieved

Abstract

Due to the universal non-verbal natural communication approach that allows for effective communication between humans, gesture recognition technology has been steadily developing over the previous few decades. Many different strategies have been presented in research articles based on gesture recognition to try to create an effective system to send non-verbal natural communication information to computers, using both physical sensors and computer vision. Hyper accurate real-time systems, on the other hand, have only recently began to occupy the study field, with each adopting a range of methodologies due to past limits such as usability, cost, speed, and accuracy. A real-time computer vision-based human-computer interaction tool for gesture recognition applications that acts as a natural user interface is proposed. Virtual glove markers on users hands will be created and used as input to a deep learning model for the real-time recognition of gestures. The results obtained show that the proposed system would be effective in real-time applications including social interaction through telepresence and rehabilitation.