Translation Memory Retrieval Methods
Michael Bloodgood, Benjamin Strauss

TL;DR
This paper evaluates various translation memory matching algorithms, including a new weighted n-gram precision method, demonstrating its superior alignment with human judgments across multiple domains and language pairs.
Contribution
Introduces a novel weighted n-gram precision algorithm that outperforms traditional edit distance methods in matching translation memories based on human helpfulness judgments.
Findings
Weighted n-gram algorithm correlates better with human judgments.
Traditional edit distance algorithms are less aligned with human preferences.
The new method is effective across multiple domains and language pairs.
Abstract
Translation Memory (TM) systems are one of the most widely used translation technologies. An important part of TM systems is the matching algorithm that determines what translations get retrieved from the bank of available translations to assist the human translator. Although detailed accounts of the matching algorithms used in commercial systems can't be found in the literature, it is widely believed that edit distance algorithms are used. This paper investigates and evaluates the use of several matching algorithms, including the edit distance algorithm that is believed to be at the heart of most modern commercial TM systems. This paper presents results showing how well various matching algorithms correlate with human judgments of helpfulness (collected via crowdsourcing with Amazon's Mechanical Turk). A new algorithm based on weighted n-gram precision that can be adjusted for…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · Topic Modeling · Multimodal Machine Learning Applications
