Gesture Recognition using Reflected Visible and Infrared Light Wave Signals

TL;DR

This paper presents a low-cost, non-contact gesture recognition system using reflected visible and infrared light signals, achieving high accuracy in diverse conditions, offering a new modality for human-computer interaction.

Contribution

The study introduces a novel light-wave-based gesture recognition method that uses incoherent light reflections, differing from radar, lidar, and camera systems, with demonstrated high accuracy.

Findings

Infrared sensing achieves 96% accuracy at 20 cm distance.

System works effectively with visible and infrared light sources.

Recognizes eight gestures across multiple subjects and conditions.

Abstract

In this paper, we demonstrate the ability to recognize hand gestures in a non-contact, wireless fashion using only incoherent light signals reflected from a human subject. Fundamentally distinguished from radar, lidar and camera-based sensing systems, this sensing modality uses only a low-cost light source (e.g., LED) and sensor (e.g., photodetector). The light-wave-based gesture recognition system identifies different gestures from the variations in light intensity reflected from the subject's hand within a short (20-35 cm) range. As users perform different gestures, scattered light forms unique, statistically repeatable, time-domain signatures. These signatures can be learned by repeated sampling to obtain the training model against which unknown gesture signals are tested and categorized. Performance evaluations have been conducted with eight gestures, five subjects, different distances and lighting conditions, and with visible and infrared light sources. The results demonstrate the best hand gesture recognition performance of infrared sensing at 20 cm with an average of 96% accuracy. The developed gesture recognition system is low-cost, effective and non-contact technology for numerous Human-computer Interaction (HCI) applications.