Morphological analysis using a sequence decoder

TL;DR

Morse is a sequence-to-sequence model that analyzes morphology by generating lemmas and features as sequences, outperforming previous models across multiple languages and resource settings.

Contribution

The paper introduces Morse, a novel encoder-decoder model that generates morphological analyses as sequences, enabling better handling of rare tags and complex inflectional structures.

Findings

Achieved state-of-the-art results in nine languages.

Handled rare and unseen tags effectively.

Produced high accuracy in Turkish morphology analysis.

Abstract

We introduce Morse, a recurrent encoder-decoder model that produces morphological analyses of each word in a sentence. The encoder turns the relevant information about the word and its context into a fixed size vector representation and the decoder generates the sequence of characters for the lemma followed by a sequence of individual morphological features. We show that generating morphological features individually rather than as a combined tag allows the model to handle rare or unseen tags and outperform whole-tag models. In addition, generating morphological features as a sequence rather than e.g.\ an unordered set allows our model to produce an arbitrary number of features that represent multiple inflectional groups in morphologically complex languages. We obtain state-of-the art results in nine languages of different morphological complexity under low-resource, high-resource and transfer learning settings. We also introduce TrMor2018, a new high accuracy Turkish morphology dataset. Our Morse implementation and the TrMor2018 dataset are available online to support future research\footnote{See \url{https://github.com/ai-ku/Morse.jl} for a Morse implementation in Julia/Knet \cite{knet2016mlsys} and \url{https://github.com/ai-ku/TrMor2018} for the new Turkish dataset.}.