Formality Style Transfer in Persian

TL;DR

This paper introduces Fa-BERT2BERT, a novel model for style transfer from informal to formal Persian text, improving NLP tools' handling of stylistic and syntactic variations with superior performance.

Contribution

The study presents a new model, Fa-BERT2BERT, incorporating consistency learning and dynamic weighting, tailored for Persian style transfer, with novel evaluation metrics.

Findings

Fa-BERT2BERT outperforms existing methods on multiple metrics.

The model effectively captures syntactic and stylistic nuances.

Evaluation metrics accurately reflect style transfer quality.

Abstract

This study explores the formality style transfer in Persian, particularly relevant in the face of the increasing prevalence of informal language on digital platforms, which poses challenges for existing Natural Language Processing (NLP) tools. The aim is to transform informal text into formal while retaining the original meaning, addressing both lexical and syntactic differences. We introduce a novel model, Fa-BERT2BERT, based on the Fa-BERT architecture, incorporating consistency learning and gradient-based dynamic weighting. This approach improves the model's understanding of syntactic variations, balancing loss components effectively during training. Our evaluation of Fa-BERT2BERT against existing methods employs new metrics designed to accurately measure syntactic and stylistic changes. Results demonstrate our model's superior performance over traditional techniques across various metrics, including BLEU, BERT score, Rouge-l, and proposed metrics underscoring its ability to adeptly navigate the complexities of Persian language style transfer. This study significantly contributes to Persian language processing by enhancing the accuracy and functionality of NLP models and thereby supports the development of more efficient and reliable NLP applications, capable of handling language style transformation effectively, thereby streamlining content moderation, enhancing data mining results, and facilitating cross-cultural communication.