Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translation

TL;DR

The paper reports on the second edition of the WMT Discourse-Level Literary Translation shared task, evaluating translation systems across three Chinese-to-other-language directions using human and automatic assessments.

Contribution

It introduces a new edition of the shared task with additional language directions and provides a comprehensive evaluation framework including human judgments.

Findings

10 submissions from 5 teams

Use of both automatic and human evaluations

Official rankings based on human judgments

Abstract

Following last year, we have continued to host the WMT translation shared task this year, the second edition of the Discourse-Level Literary Translation. We focus on three language directions: Chinese-English, Chinese-German, and Chinese-Russian, with the latter two ones newly added. This year, we totally received 10 submissions from 5 academia and industry teams. We employ both automatic and human evaluations to measure the performance of the submitted systems. The official ranking of the systems is based on the overall human judgments. We release data, system outputs, and leaderboard at https://www2.statmt.org/wmt24/literary-translation-task.html.