Sing it, Narrate it: Quality Musical Lyrics Translation
Zhuorui Ye, Jinhan Li, Rongwu Xu

TL;DR
This paper presents a novel approach to translating musical lyrics that balances translation quality with singability constraints, using a new dataset, a two-stage training process, and inference-time optimization, validated through extensive evaluations.
Contribution
It introduces a comprehensive framework combining dataset creation, two-stage training, and inference optimization to improve musical lyrics translation quality while maintaining singability.
Findings
Significant improvement in translation quality over baselines
Effective preservation of singability features in translations
Validated through extensive automatic and human evaluations
Abstract
Translating lyrics for musicals presents unique challenges due to the need to ensure high translation quality while adhering to singability requirements such as length and rhyme. Existing song translation approaches often prioritize these singability constraints at the expense of translation quality, which is crucial for musicals. This paper aims to enhance translation quality while maintaining key singability features. Our method consists of three main components. First, we create a dataset to train reward models for the automatic evaluation of translation quality. Second, to enhance both singability and translation quality, we implement a two-stage training process with filtering techniques. Finally, we introduce an inference-time optimization framework for translating entire songs. Extensive experiments, including both automatic and human evaluations, demonstrate significant…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
Taxonomy
TopicsDiverse Musicological Studies · Translation Studies and Practices · Music and Audio Processing
