Real-Time Human-Computer Interaction Based on Face and Hand Gesture Recognition

TL;DR

This paper presents a real-time face and hand gesture recognition system for human-computer interaction, capable of controlling media playback and recognizing American Sign Language with high accuracy.

Contribution

It introduces a combined face and hand gesture recognition approach using skin and cascade detectors, achieving high precision and applicability in media control and sign language recognition.

Findings

Achieved approximately 99.40% correctness rate in ASL gesture recognition.

Demonstrated high precision in real-time face and hand gesture detection.

Applicable to gesture-based gaming and virtual reality environments.

Abstract

At the present time, hand gestures recognition system could be used as a more expected and useable approach for human computer interaction. Automatic hand gesture recognition system provides us a new tactic for interactive with the virtual environment. In this paper, a face and hand gesture recognition system which is able to control computer media player is offered. Hand gesture and human face are the key element to interact with the smart system. We used the face recognition scheme for viewer verification and the hand gesture recognition in mechanism of computer media player, for instance, volume down/up, next music and etc. In the proposed technique, first, the hand gesture and face location is extracted from the main image by combination of skin and cascade detector and then is sent to recognition stage. In recognition stage, first, the threshold condition is inspected then the extracted face and gesture will be recognized. In the result stage, the proposed technique is applied on the video dataset and the high precision ratio acquired. Additional the recommended hand gesture recognition method is applied on static American Sign Language (ASL) database and the correctness rate achieved nearby 99.40%. also the planned method could be used in gesture based computer games and virtual reality.