SinaTools: Open Source Toolkit for Arabic Natural Language Processing

TL;DR

SinaTools is an open-source Python toolkit that provides comprehensive Arabic NLP solutions, outperforming existing tools across multiple tasks like NER, WSD, and POS tagging, facilitating easier integration into systems.

Contribution

This paper introduces SinaTools, a unified open-source toolkit for Arabic NLP that achieves state-of-the-art performance on various tasks, streamlining Arabic language processing workflows.

Findings

SinaTools achieves 87.33% on flat NER

SinaTools attains 89.42% on nested NER

SinaTools scores 97.5% on POS tagging

Abstract

We introduce SinaTools, an open-source Python package for Arabic natural language processing and understanding. SinaTools is a unified package allowing people to integrate it into their system workflow, offering solutions for various tasks such as flat and nested Named Entity Recognition (NER), fully-flagged Word Sense Disambiguation (WSD), Semantic Relatedness, Synonymy Extractions and Evaluation, Lemmatization, Part-of-speech Tagging, Root Tagging, and additional helper utilities such as corpus processing, text stripping methods, and diacritic-aware word matching. This paper presents SinaTools and its benchmarking results, demonstrating that SinaTools outperforms all similar tools on the aforementioned tasks, such as Flat NER (87.33%), Nested NER (89.42%), WSD (82.63%), Semantic Relatedness (0.49 Spearman rank), Lemmatization (90.5%), POS tagging (97.5%), among others. SinaTools can be downloaded from (https://sina.birzeit.edu/sinatools).