Reflective Translation: Improving Low-Resource Machine Translation via Structured Self-Reflection

TL;DR

This paper presents Reflective Translation, a prompt-based method that enhances low-resource machine translation by having models critique and revise their outputs, leading to consistent quality improvements without fine-tuning.

Contribution

It introduces a structured self-reflection framework for translation that improves quality in low-resource languages without additional training or fine-tuning.

Findings

BLEU and COMET scores improved significantly

Method is model-agnostic and requires no fine-tuning

Reflection-augmented dataset supports future research

Abstract

Low-resource languages such as isiZulu and isiXhosa face persistent challenges in machine translation due to limited parallel data and linguistic resources. Recent advances in large language models suggest that self-reflection, prompting a model to critique and revise its own outputs, can improve reasoning quality and factual consistency. Building on this idea, this paper introduces Reflective Translation, a prompt-based framework in which a model generates an initial translation, produces a structured self-critique, and then uses this reflection to generate a refined translation. The approach is evaluated on English-isiZulu and English-isiXhosa translation using OPUS-100 and NTREX-African, across multiple prompting strategies and confidence thresholds. Results show consistent improvements in both BLEU and COMET scores between first- and second-pass translations, with average gains of up to +0.22 BLEU and +0.18 COMET. Statistical significance testing using paired nonparametric tests confirms that these improvements are robust. The proposed method is model-agnostic, requires no fine-tuning, and introduces a reflection-augmented dataset that can support future supervised or analysis-driven work. These findings demonstrate that structured self-reflection is a practical and effective mechanism for improving translation quality in low-resource settings.