Toward a Motor Theory of Sign Language Perception

TL;DR

This paper explores a motor theory of perception for sign language, proposing a methodology that links linguistic knowledge with sensory-motor processes to improve analysis, synthesis, and evaluation of gestures.

Contribution

It introduces a novel motor-based framework for sign language perception, integrating motion and meaning through a synthesis-by-analysis methodology.

Findings

Illustrates concepts with existing study examples

Proposes a new evaluation-guided methodology

Suggests future research directions in motor sign language perception

Abstract

Researches on signed languages still strongly dissociate lin- guistic issues related on phonological and phonetic aspects, and gesture studies for recognition and synthesis purposes. This paper focuses on the imbrication of motion and meaning for the analysis, synthesis and evaluation of sign language gestures. We discuss the relevance and interest of a motor theory of perception in sign language communication. According to this theory, we consider that linguistic knowledge is mapped on sensory-motor processes, and propose a methodology based on the principle of a synthesis-by-analysis approach, guided by an evaluation process that aims to validate some hypothesis and concepts of this theory. Examples from existing studies illustrate the di erent concepts and provide avenues for future work.