Vietnamese Capitalization and Punctuation Recovery Models

TL;DR

This paper introduces a new dataset and a joint model for restoring capitalization and punctuation in Vietnamese text, improving NLP processing for low-resource languages.

Contribution

It provides the first public Vietnamese dataset for this task and proposes a novel joint model that outperforms previous methods.

Findings

Joint model outperforms single-task models

Dataset improves research in Vietnamese NLP

Model achieves state-of-the-art results on the dataset

Abstract

Despite the rise of recent performant methods in Automatic Speech Recognition (ASR), such methods do not ensure proper casing and punctuation for their outputs. This problem has a significant impact on the comprehension of both Natural Language Processing (NLP) algorithms and human to process. Capitalization and punctuation restoration is imperative in pre-processing pipelines for raw textual inputs. For low resource languages like Vietnamese, public datasets for this task are scarce. In this paper, we contribute a public dataset for capitalization and punctuation recovery for Vietnamese; and propose a joint model for both tasks named JointCapPunc. Experimental results on the Vietnamese dataset show the effectiveness of our joint model compare to single model and previous joint learning model. We publicly release our dataset and the implementation of our model at https://github.com/anhtunguyen98/JointCapPunc