DGT-TM: A freely Available Translation Memory in 22 Languages

TL;DR

The paper introduces DGT-TM, a large, freely available translation memory for 22 EU languages, useful for translation, language research, and machine translation applications.

Contribution

It provides a comprehensive, publicly accessible multilingual translation memory covering 22 languages, with details on its creation, size, and potential uses.

Findings

Contains millions of sentence pairs across 22 languages

Enables improved translation consistency and research applications

Supports various language technology tasks

Abstract

The European Commission's (EC) Directorate General for Translation, together with the EC's Joint Research Centre, is making available a large translation memory (TM; i.e. sentences and their professionally produced translations) covering twenty-two official European Union (EU) languages and their 231 language pairs. Such a resource is typically used by translation professionals in combination with TM software to improve speed and consistency of their translations. However, this resource has also many uses for translation studies and for language technology applications, including Statistical Machine Translation (SMT), terminology extraction, Named Entity Recognition (NER), multilingual classification and clustering, and many more. In this reference paper for DGT-TM, we introduce this new resource, provide statistics regarding its size, and explain how it was produced and how to use it.