PerSign: Personalized Bangladeshi Sign Letters Synthesis

TL;DR

PerSign is a personalized image translation system that synthesizes Bangladeshi Sign Language letters onto individual images, maintaining the person's appearance while accurately depicting sign gestures to aid communication.

Contribution

It introduces a novel personalized sign language synthesis system using image-to-image translation and a unique dataset for Bangladeshi Sign Language.

Findings

Successfully generates personalized sign language images.

Maintains original image profile while adding sign gestures.

Potential to bridge communication gap for non-signers.

Abstract

Bangladeshi Sign Language (BdSL) - like other sign languages - is tough to learn for general people, especially when it comes to expressing letters. In this poster, we propose PerSign, a system that can reproduce a person's image by introducing sign gestures in it. We make this operation personalized, which means the generated image keeps the person's initial image profile - face, skin tone, attire, background - unchanged while altering the hand, palm, and finger positions appropriately. We use an image-to-image translation technique and build a corresponding unique dataset to accomplish the task. We believe the translated image can reduce the communication gap between signers (person who uses sign language) and non-signers without having prior knowledge of BdSL.