Sequence-to-Sequence Resources for Catalan

TL;DR

This paper introduces new sequence-to-sequence language resources for Catalan, including datasets for summarization and machine translation, along with baselines and a Catalan BART model to foster NLP development in the language.

Contribution

The work provides the first comprehensive Catalan datasets for summarization and translation, along with baseline models and open resources to advance Catalan NLP research.

Findings

New Catalan summarization datasets created

A parallel Catalan-English corpus with test sets developed

Baseline models established for summarization and translation

Abstract

In this work, we introduce sequence-to-sequence language resources for Catalan, a moderately under-resourced language, towards two tasks, namely: Summarization and Machine Translation (MT). We present two new abstractive summarization datasets in the domain of newswire. We also introduce a parallel Catalan-English corpus, paired with three different brand new test sets. Finally, we evaluate the data presented with competing state of the art models, and we develop baselines for these tasks using a newly created Catalan BART. We release the resulting resources of this work under open license to encourage the development of language technology in Catalan.