Coherency in One-Shot Gesture Recognition
Maria Cabrera, Richard Voyles, Juan Wachs

TL;DR
This paper introduces a framework for one-shot gesture recognition that generates realistic gesture samples from minimal data, and proposes a new coherency metric to evaluate the agreement between machine and human recognition.
Contribution
It presents a novel approach focusing on gesture generation from single observations using human interaction characteristics, and introduces a coherency metric for validation.
Findings
Achieved 89.2% recognition accuracy with classifiers
Human recognition of robot-performed gestures reached 92.5%
Proposed coherency metric showed 93.6% agreement between machine and human recognition
Abstract
User's intentions may be expressed through spontaneous gesturing, which have been seen only a few times or never before. Recognizing such gestures involves one shot gesture learning. While most research has focused on the recognition of the gestures itself, recently new approaches were proposed to deal with gesture perception and production as part of the same problem. The framework presented in this work focuses on learning the process that leads to gesture generation, rather than mining the gesture's associated features. This is achieved using kinematic, cognitive and biomechanic characteristics of human interaction. These factors enable the artificial production of realistic gesture samples originated from a single observation. The generated samples are then used as training sets for different state-of-the-art classifiers. Performance is obtained first, by observing the machines'…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHand Gesture Recognition Systems · Hearing Impairment and Communication · Gait Recognition and Analysis
