Utilize Transformers for translating Wikipedia category names
Hoang-Thang Ta, Quoc Thang La

TL;DR
This paper presents a Transformer-based approach for translating Wikipedia category names from English to Vietnamese, demonstrating effective performance with resource-efficient models and a specialized dataset.
Contribution
It introduces a dataset of 15,000 English-Vietnamese category pairs and fine-tunes Transformer models for category translation, highlighting OPUS-MT-en-vi's superior BLEU score.
Findings
OPUS-MT-en-vi achieved a BLEU score of 0.73
Transformer models outperformed baseline methods
Resource-efficient models can effectively translate Wikipedia categories
Abstract
On Wikipedia, articles are categorized to aid readers in navigating content efficiently. The manual creation of new categories can be laborious and time-intensive. To tackle this issue, we built language models to translate Wikipedia categories from English to Vietnamese with a dataset containing 15,000 English-Vietnamese category pairs. Subsequently, small to medium-scale Transformer pre-trained models with a sequence-to-sequence architecture were fine-tuned for category translation. The experiments revealed that OPUS-MT-en-vi surpassed other models, attaining the highest performance with a BLEU score of 0.73, despite its smaller model storage. We expect our paper to be an alternative solution for translation tasks with limited computer resources.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · Wikis in Education and Collaboration · Translation Studies and Practices
MethodsLinear Layer · Residual Connection · Multi-Head Attention · Attention Is All You Need · Position-Wise Feed-Forward Layer · Adam · Byte Pair Encoding · Softmax · Absolute Position Encodings · Dense Connections
