Revisiting Classification Taxonomy for Grammatical Errors

TL;DR

This paper critically evaluates existing grammatical error classification taxonomies using a new systematic framework, revealing their shortcomings and proposing improvements to enhance error analysis and feedback for language learners.

Contribution

It introduces a comprehensive evaluation framework for grammatical error taxonomies and provides a high-quality dataset to benchmark and improve their effectiveness.

Findings

Existing taxonomies have significant drawbacks in exclusivity and coverage.

The evaluation framework effectively identifies inconsistencies in taxonomies.

Proposed improvements lead to more precise and actionable error feedback.

Abstract

Grammatical error classification plays a crucial role in language learning systems, but existing classification taxonomies often lack rigorous validation, leading to inconsistencies and unreliable feedback. In this paper, we revisit previous classification taxonomies for grammatical errors by introducing a systematic and qualitative evaluation framework. Our approach examines four aspects of a taxonomy, i.e., exclusivity, coverage, balance, and usability. Then, we construct a high-quality grammatical error classification dataset annotated with multiple classification taxonomies and evaluate them grounding on our proposed evaluation framework. Our experiments reveal the drawbacks of existing taxonomies. Our contributions aim to improve the precision and effectiveness of error analysis, providing more understandable and actionable feedback for language learners.