# Recurrent Neural Networks for Mexican Sign Language Interpretation in Healthcare Services

## TL;DR

This paper introduces a dataset and recurrent neural networks to improve Mexican Sign Language interpretation for healthcare, aiming to reduce communication barriers for the Deaf community.

## Contribution

The study presents a health-focused MSL dataset and evaluates sequential narrative inference, a novel approach for MSL in healthcare.

## Key findings

- The best model achieved 98.36% precision in isolated sign classification.
- The system reached 45.45% global sequential recall for short narratives.
- Results highlight challenges in continuous signing and signer variation.

## Abstract

In Mexico, the Deaf community faces persistent communication barriers that restrict their integration and access to essential services, particularly in healthcare. Even though approximately two million individuals use Mexican Sign Language (MSL) as their primary form of communication, technological tools for supporting effective interaction remain limited. While recent research in sign-language recognition has led to important advances for several languages, work focused on MSL, particularly for healthcare scenarios, remains scarce. To address this gap, this study introduces a health-oriented dataset of 150 signs, with 800 synthetic video sequences per word, totaling more than 35 GB of data. This dataset was used to train recurrent neural networks with regularization and data augmentation. The best configuration achieved a maximum precision of 98.36% in isolated sign classification, minimizing false positives, which is an essential requirement in clinical applications. Beyond isolated recognition, the main contribution of this study is its exploratory evaluation of sequential narrative inference in MSL. Using short scripted narratives, the system achieved a global sequential recall of 45.45% under a realistic evaluation protocol that enforces temporal alignment. These results highlight both the potential of recurrent architectures in generalizing from isolated gestures to structured sequences and the substantial challenges posed by continuous signing, co-articulation, and signer-specific variation. While not intended for clinical deployment, the methodology, dataset, and open-source implementation presented here establish a reproducible baseline for future research. This work provides initial evidence, tools, and insights to support the long-term development of accessible technologies for the Deaf community in Mexico.