Wisture: RNN-based Learning of Wireless Signals for Gesture Recognition in Unmodified Smartphones

TL;DR

Wisture is a novel Wi-Fi RSS-based gesture recognition system for smartphones that uses LSTM RNNs, achieving high accuracy without hardware modifications or interfering with normal device operation.

Contribution

It introduces a hardware-agnostic, real-time gesture recognition method using Wi-Fi RSS and LSTM RNNs, outperforming existing solutions in accuracy and efficiency.

Findings

Achieves up to 94% recognition accuracy

Operates without hardware modifications

Works in diverse spatial and traffic scenarios

Abstract

This paper introduces Wisture, a new online machine learning solution for recognizing touch-less dynamic hand gestures on a smartphone. Wisture relies on the standard Wi-Fi Received Signal Strength (RSS) using a Long Short-Term Memory (LSTM) Recurrent Neural Network (RNN), thresholding filters and traffic induction. Unlike other Wi-Fi based gesture recognition methods, the proposed method does not require a modification of the smartphone hardware or the operating system, and performs the gesture recognition without interfering with the normal operation of other smartphone applications. We discuss the characteristics of Wisture, and conduct extensive experiments to compare its performance against state-of-the-art machine learning solutions in terms of both accuracy and time efficiency. The experiments include a set of different scenarios in terms of both spatial setup and traffic between the smartphone and Wi-Fi access points (AP). The results show that Wisture achieves an online recognition accuracy of up to 94% (average 78%) in detecting and classifying three hand gestures.