R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning
  Learning
Despite recent breakthroughs in reasoning-enhanced large language models
(LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine
translation (MT), where human translators naturally employ structured,
multi-layered reasoning chain-of-thoughts (CoTs), is yet underexplored.
Existing methods either design a fixed CoT tailored for a specific MT sub-task
(e.g., literature translation), or rely on synthesizing CoTs unaligned with
humans and supervised fine-tuning (SFT) prone to catastrophic forgetting,
limiting their adaptability to diverse translation scenarios. This paper
introduces R1-Translator (R1-T1), a novel framework to achieve inference-time
reasoning for general MT via reinforcement learning (RL) with human-aligned
CoTs comprising six common patterns. Our approach pioneers three innovations:
(1) extending reasoning-based translation beyond MT sub-tasks to six languages
and diverse tasks (e.g., legal/medical domain adaptation, idiom resolution);
(2) formalizing six expert-curated CoT templates that mirror hybrid human
strategies like context-aware paraphrasing and back translation; and (3)
enabling self-evolving CoT discovery and anti-forgetting adaptation through RL
with KL-constrained rewards. Experimental results indicate a steady translation
performance improvement in 21 languages and 80 translation directions on
Flores-101 test set, especially on the 15 languages unseen from training, with
its general multilingual abilities preserved compared with plain SFT.
67c1438fd7ffcd1cab1fc412
Minggui He
extracted_pending
2025-02-28T05:03:12.675Z
6727998d4fc2e4f7cc0c85d3
/avatars/ac18eaadd606f7fae64996502f393cf2.svg
he
boommmmm
user
boommmmm
67c1438fd7ffcd1cab1fc413
Yilun Liu
claimed_verified
2025-03-04T08:52:32.981Z
67c676d517073afcaa053da9
/avatars/3bbfd9fd20b2e6f9dd40c2fc7f74e241.svg
Yilun Liu
lunyiliu
user
lunyiliu
67c1438fd7ffcd1cab1fc414
Shimin Tao
67c1438fd7ffcd1cab1fc415
Yuanchang Luo
67c1438fd7ffcd1cab1fc416
Hongyong Zeng
67c1438fd7ffcd1cab1fc417
Chang Su
67c1438fd7ffcd1cab1fc418
Li Zhang
67c1438fd7ffcd1cab1fc419
Hongxia Ma
67c1438fd7ffcd1cab1fc41a
Daimeng Wei
67c1438fd7ffcd1cab1fc41b
Weibin Meng
admin_assigned
2025-02-28T12:44:36.712Z
67285a87e347d62d66473b9a
/avatars/6aeb022c2728ace62bf6884fdb3c9f9c.svg
WeibinMeng
weibinmeng
user
weibinmeng
67c1438fd7ffcd1cab1fc41c
Hao Yang
67c1438fd7ffcd1cab1fc41d
Boxing Chen
admin_assigned
2025-02-28T12:44:51.085Z
66f98351ee969ff116986327
/avatars/e038ef1462f77f5e87e868339993f92d.svg
Boxing Chen
BoxingChen
user
BoxingChen
67c1438fd7ffcd1cab1fc41e
Osamu Yoshie
R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning
  Learning
Despite recent breakthroughs in reasoning-enhanced large language models
(LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine
translation (MT), where human translators naturally employ structured,
multi-layered reasoning chain-of-thoughts (CoTs), is yet underexplored.
Existing methods either design a fixed CoT tailored for a specific MT sub-task
(e.g., literature translation), or rely on synthesizing CoTs unaligned with
humans and supervised fine-tuning (SFT) prone to catastrophic forgetting,
limiting their adaptability to diverse translation scenarios. This paper
introduces R1-Translator (R1-T1), a novel framework to achieve inference-time
reasoning for general MT via reinforcement learning (RL) with human-aligned
CoTs comprising six common patterns. Our approach pioneers three innovations:
(1) extending reasoning-based translation beyond MT sub-tasks to six languages
and diverse tasks (e.g., legal/medical domain adaptation, idiom resolution);
(2) formalizing six expert-curated CoT templates that mirror hybrid human
strategies like context-aware paraphrasing and back translation; and (3)
enabling self-evolving CoT discovery and anti-forgetting adaptation through RL
with KL-constrained rewards. Experimental results indicate a steady translation
performance improvement in 21 languages and 80 translation directions on
Flores-101 test set, especially on the 15 languages unseen from training, with
its general multilingual abilities preserved compared with plain SFT.
A novel framework, R1-Translator, uses reinforcement learning with human-aligned chain-of-thoughts to enhance reasoning in machine translation across diverse languages and tasks.
reasoning-enhanced large language models machine translation chain-of-thoughts inference-time reasoning reinforcement learning KL-constrained rewards