Bidirectional American Sign Language to English Translation
Hardie Cate, Zeshan Hussain

TL;DR
This paper presents a bidirectional translation system between American Sign Language and English using an adapted IBM WAM1 model, enabling translation quality assessment based on fluency and faithfulness.
Contribution
It introduces a novel generative approach for ASL-English translation by modifying the IBM WAM1 model to handle sign language and spoken language translation.
Findings
Effective translation model for ASL-English pair
Quantitative measures of translation fluency and faithfulness
Bidirectional translation capability
Abstract
We outline a bidirectional translation system that converts sentences from American Sign Language (ASL) to English, and vice versa. To perform machine translation between ASL and English, we utilize a generative approach. Specifically, we employ an adjustment to the IBM word-alignment model 1 (IBM WAM1), where we define language models for English and ASL, as well as a translation model, and attempt to generate a translation that maximizes the posterior distribution defined by these models. Then, using these models, we are able to quantify the concepts of fluency and faithfulness of a translation between languages.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · Speech and dialogue systems · Hearing Impairment and Communication
