From Labels to Facets: Building a Taxonomically Enriched Turkish Learner Corpus

TL;DR

This paper introduces a semi-automated, taxonomically enriched annotation methodology for Turkish learner corpora, enabling detailed, multi-dimensional linguistic error analysis and improving querying and research capabilities.

Contribution

It presents the first Turkish learner corpus annotated with a multi-dimensional taxonomy and an annotation extension tool that enhances flat annotations with rich linguistic facets.

Findings

Facet-level accuracy of 95.86% achieved

Enables detailed error pattern analysis across linguistic dimensions

Supports advanced querying and exploratory research

Abstract

In terms of annotation structure, most learner corpora rely on holistic flat label inventories which, even when extensive, do not explicitly separate multiple linguistic dimensions. This makes linguistically deep annotation difficult and complicates fine-grained analyses aimed at understanding why and how learners produce specific errors. To address these limitations, this paper presents a semi-automated annotation methodology for learner corpora, built upon a recently proposed faceted taxonomy, and implemented through a novel annotation extension framework. The taxonomy provides a theoretically grounded, multi-dimensional categorization that captures the linguistic properties underlying each error instance, thereby enabling standardized, fine-grained, and interpretable enrichment beyond flat annotations. The annotation extension tool, implemented based on the proposed extension framework for Turkish, automatically extends existing flat annotations by inferring additional linguistic and metadata information as facets within the taxonomy to provide richer learner-specific context. It was systematically evaluated and yielded promising performance results, achieving a facet-level accuracy of 95.86%. The resulting taxonomically enriched corpus offers enhanced querying capabilities and supports detailed exploratory analyses across learner corpora, enabling researchers to investigate error patterns through complex linguistic and pedagogical dimensions. This work introduces the first collaboratively annotated and taxonomically enriched Turkish Learner Corpus, a manual annotation guideline with a refined tagset, and an annotation extender. As the first corpus designed in accordance with the recently introduced taxonomy, we expect our study to pave the way for subsequent enrichment efforts of existing error-annotated learner corpora.