Tesla-Rapture: A Lightweight Gesture Recognition System from mmWave Radar Point Clouds
Dariush Salami, Ramin Hasibi, Sameera Palipana, Petar Popovski, Tom, Michoel, and Stephan Sigg

TL;DR
Tesla-Rapture introduces a lightweight, accurate gesture recognition system using mmWave radar point clouds, enabling real-time performance on constrained devices like Raspberry Pi with significant improvements over existing methods.
Contribution
The paper develops Tesla, a novel MPNN graph convolution model for radar point clouds, achieving higher accuracy and faster prediction times than state-of-the-art methods, suitable for embedded systems.
Findings
Tesla outperforms existing models in accuracy.
Tesla predicts gestures nearly 8 times faster.
The system generalizes well across different scenarios.
Abstract
We present Tesla-Rapture, a gesture recognition interface for point clouds generated by mmWave Radars. State of the art gesture recognition models are either too resource consuming or not sufficiently accurate for integration into real-life scenarios using wearable or constrained equipment such as IoT devices (e.g. Raspberry PI), XR hardware (e.g. HoloLens), or smart-phones. To tackle this issue, we developed Tesla, a Message Passing Neural Network (MPNN) graph convolution approach for mmWave radar point clouds. The model outperforms the state of the art on two datasets in terms of accuracy while reducing the computational complexity and, hence, the execution time. In particular, the approach, is able to predict a gesture almost 8 times faster than the most accurate competitor. Our performance evaluation in different scenarios (environments, angles, distances) shows that Tesla…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHand Gesture Recognition Systems · Gait Recognition and Analysis · Human Pose and Action Recognition
MethodsConvolution
