Hand Gesture Detection and Conversion to Speech and Text

TL;DR

This paper presents a system that automatically recognizes hand gestures from images to convert sign language into speech and text, aiding communication for hearing-impaired individuals.

Contribution

It introduces a gesture recognition method using contour features and integrates it with speech and text output for sign language translation.

Findings

Effective gesture recognition from images

Successful conversion of gestures to speech and text

Potential to improve communication for hearing-impaired

Abstract

The hand gestures are one of the typical methods used in sign language. It is very difficult for the hearing-impaired people to communicate with the world. This project presents a solution that will not only automatically recognize the hand gestures but will also convert it into speech and text output so that impaired person can easily communicate with normal people. A camera attached to computer will capture images of hand and the contour feature extraction is used to recognize the hand gestures of the person. Based on the recognized gestures, the recorded soundtrack will be played.