# KuSL2023: A standard for Kurdish sign language detection and classification using hand tracking and machine learning

## TL;DR

This paper introduces a new standard for recognizing and classifying Kurdish Sign Language using a large dataset and machine learning models to improve communication for the deaf community.

## Contribution

The paper provides the first standardized dataset for Kurdish Sign Language with 71,400 annotated images and demonstrates high accuracy using CNN and traditional models.

## Key findings

- A standardized Kurdish Sign Language dataset was created with 71,400 images from ASL and ArSL2018 datasets.
- CNN achieved 98.22% accuracy, while KNN and LightGBM reached 95.98% and 96.94% with faster training times.
- The dataset supports real-time hand sign recognition and assistive technologies for the deaf community.

## Abstract

Sign Language Recognition (SLR) plays a vital role in enhancing communication for the deaf and hearing-impaired communities, yet there has been a lack of resources for Kurdish Sign Language (KuSL). To address this, a comprehensive standard for KuSL detection and classification has been introduced. This standard includes the creation of a real-time KuSL recognition dataset, focusing on hand shape classification, composed of 71,400 images derived from merging and refining two key datasets: ASL and ArSL2018. The ArSL2018 dataset, aligned with the Kurdish script, contributed 54,049 images, while the ASL dataset added 78,000 RGB images, representing 34 Kurdish sign categories and capturing a variety of lighting conditions, angles, and backgrounds. Various machine learning models were employed to evaluate system performance. The CNN model achieved an accuracy of 98.22 %, while traditional classifiers such as KNN and LightGBM reached 95.98 % and 96.94 %, respectively, with considerably faster training times. These findings underscore the robustness of the KuSL dataset, which not only delivers high accuracy and efficiency but also sets a new benchmark for advancing Kurdish Sign Language recognition and broader gesture recognition technology.•Provides the first standardized dataset for Kurdish Sign Language recognition using 71,400 annotated images.•Demonstrates high classification accuracy using CNN (98.22 %) and traditional models like KNN and LightGBM.•Enables real-time hand sign recognition and supports the development of assistive technologies for the deaf community.

Provides the first standardized dataset for Kurdish Sign Language recognition using 71,400 annotated images.

Demonstrates high classification accuracy using CNN (98.22 %) and traditional models like KNN and LightGBM.

Enables real-time hand sign recognition and supports the development of assistive technologies for the deaf community.

Image, graphical abstract