An Empirical Study of On-Device Translation for Real-Time Live-Stream Chat on Mobile Devices
Jeiyoon Park, Daehwan Lee, Changmin Yeo, Yongshin Han, Minseop Kim

TL;DR
This study evaluates the practical deployment of on-device translation models for real-time live-stream chat on mobile devices, focusing on resource consumption, model selection, and domain adaptation, with experiments on a new benchmark and multiple devices.
Contribution
It provides an empirical analysis of on-device translation models, introduces LiveChatBench benchmark, and compares model performance and resource usage on mobile devices.
Findings
On-device models can achieve performance comparable to commercial models like GPT-5.1.
Resource constraints significantly impact model deployment choices.
Domain adaptation capabilities vary across models and devices.
Abstract
Despite its efficiency, there has been little research on the practical aspects required for real-world deployment of on-device AI models, such as the device's CPU utilization and thermal conditions. In this paper, through extensive experiments, we investigate two key issues that must be addressed to deploy on-device models in real-world services: (i) the selection of on-device models and the resource consumption of each model, and (ii) the capability and potential of on-device models for domain adaptation. To this end, we focus on a task of translating live-stream chat messages and manually construct LiveChatBench, a benchmark consisting of 1,000 Korean-English parallel sentence pairs. Experiments on five mobile devices demonstrate that, although serving a large and heterogeneous user base requires careful consideration of highly constrained deployment settings and model selection, the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSpreadsheets and End-User Computing · ICT in Developing Communities · IoT and Edge/Fog Computing
