Beyond English: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs
Large language models have significantly advanced Multilingual Machine Translation (MMT), yet the broad language coverage, consistent translation quality, and English-centric bias remain open challenges. To address these challenges, we introduce LMT, a suite of Large-scale Multilingual Translation models centered on both Chinese and English, covering 60 languages and 234 translation directions. During development, we identify a previously overlooked phenomenon of directional degeneration, where symmetric multi-way fine-tuning data overemphasize reverse directions (X to En/Zh), leading to excessive many-to-one mappings and degraded translation quality. We propose Strategic Downsampling, a simple yet effective method to mitigate this degeneration. In addition, we design Parallel Multilingual Prompting (PMP), which leverages typologically related auxiliary languages to enhance cross-lingual transfer. Through rigorous data curation and refined adaptation strategies, LMT achieves SOTA performance among models of comparable language coverage, with our 4B model (LMT-60-4B) surpassing the much larger Aya-101-13B and NLLB-54B models by a substantial margin. We release LMT in four sizes (0.6B/1.7B/4B/8B) to catalyze future research and provide strong baselines for inclusive, scalable, and high-quality MMT \href{https://github.com/NiuTrans/LMT{https://github.com/NiuTrans/LMT}}.
69134d59a644ba07c499c8f8
Yingfeng Luo
claimed_verified
2025-11-12T12:19:09.432Z
6440b38d3e0374802e1acc5e
https://cdn-avatars.huggingface.co/v1/production/uploads/6440b38d3e0374802e1acc5e/w-ZpW_9gCSHUeDKyGSeMt.jpeg
luoyingfeng
luoyingfeng
user
luoyingfeng
69134d59a644ba07c499c8f9
Ziqiang Xu
claimed_verified
2025-11-12T12:19:07.336Z
6705da8fee4c6f44cfb83d3f
/avatars/53cad64bb8acc40a070060a5c7a7dc2d.svg
Xu Ziqiang
sleepyhead111
user
sleepyhead111
69134d59a644ba07c499c8fa
Yuxuan Ouyang
69134d59a644ba07c499c8fb
Murun Yang
69134d59a644ba07c499c8fc
Dingyang Lin
69134d59a644ba07c499c8fd
Kaiyan Chang
claimed_verified
2025-11-13T13:07:00.375Z
6558c69ad1c2d6b28be8c133
/avatars/0f23727bee787f8428820f3a22b35d5e.svg
Kaiyan Chang
lucky-259
user
lucky-259
69134d59a644ba07c499c8fe
Tong Zheng
69134d59a644ba07c499c8ff
Bei Li
69134d59a644ba07c499c900
Peinan Feng
claimed_verified
2025-11-13T13:06:58.414Z
67d90d2f1fd0e259d25c61be
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/ooy_5Lzh3O9gi9IEATYdA.png
Peinan Feng
fpnBytedance
user
fpnBytedance
69134d59a644ba07c499c901
Quan Du
69134d59a644ba07c499c902
Tong Xiao
claimed_verified
2025-12-01T16:24:57.056Z
67c5249a64910c03522af447
https://cdn-avatars.huggingface.co/v1/production/uploads/67c5249a64910c03522af447/A5h3SWp5AcamJkH150nPF.png
Tong Xiao
neupupil
user
neupupil
69134d59a644ba07c499c903
Jingbo Zhu
Beyond English: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs
Large language models have significantly advanced Multilingual Machine Translation (MMT), yet the broad language coverage, consistent translation quality, and English-centric bias remain open challenges. To address these challenges, we introduce LMT, a suite of Large-scale Multilingual Translation models centered on both Chinese and English, covering 60 languages and 234 translation directions. During development, we identify a previously overlooked phenomenon of directional degeneration, where symmetric multi-way fine-tuning data overemphasize reverse directions (X to En/Zh), leading to excessive many-to-one mappings and degraded translation quality. We propose Strategic Downsampling, a simple yet effective method to mitigate this degeneration. In addition, we design Parallel Multilingual Prompting (PMP), which leverages typologically related auxiliary languages to enhance cross-lingual transfer. Through rigorous data curation and refined adaptation strategies, LMT achieves SOTA performance among models of comparable language coverage, with our 4B model (LMT-60-4B) surpassing the much larger Aya-101-13B and NLLB-54B models by a substantial margin. We release LMT in four sizes (0.6B/1.7B/4B/8B) to catalyze future research and provide strong baselines for inclusive, scalable, and high-quality MMT \href{https://github.com/NiuTrans/LMT{https://github.com/NiuTrans/LMT}}.
LMT, a suite of large-scale multilingual translation models, addresses challenges in multilingual machine translation through strategic downsampling and parallel multilingual prompting, achieving state-of-the-art performance across 60 languages.
LMT Large-scale Multilingual Translation directional degeneration Strategic Downsampling Parallel Multilingual Prompting cross-lingual transfer multilingual machine translation