TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning
Large Reasoning Models (LRMs) achieve impressive performance on complex reasoning tasks via Chain-of-Thought (CoT) reasoning, which enables them to generate intermediate thinking tokens before arriving at the final answer. However, LRMs often suffer from significant overthinking, spending excessive compute time even after the answer is generated early on. Prior work has identified the existence of an optimal reasoning length such that truncating reasoning at this point significantly shortens CoT outputs with virtually no change in performance. However, determining optimal CoT lengths for practical datasets is highly non-trivial as they are fully task and model-dependent. In this paper, we precisely address this and design TERMINATOR, an early-exit strategy for LRMs at inference to mitigate overthinking. The central idea underpinning TERMINATOR is that the first arrival of an LRM's final answer is often predictable, and we leverage these first answer positions to create a novel dataset of optimal reasoning lengths to train TERMINATOR. Powered by this approach, TERMINATOR achieves significant reductions in CoT lengths of 14%-55% on average across four challenging practical datasets: MATH-500, AIME 2025, HumanEval, and GPQA, whilst outperforming current state-of-the-art methods.
69b75d8291a28162b233fbb5
Alliot Nagle
claimed_verified
2026-03-16T10:40:23.639Z
631c16bc7d57669121d2a274
/avatars/b2529b8721f2b9e4cbdbf11d1a2f4b47.svg
Alliot
acnagle
user
acnagle
69b75d8291a28162b233fbb6
Jakhongir Saydaliev
admin_assigned
2026-03-17T08:48:26.122Z
655b2b2ca75de9cef1e06aa7
/avatars/92032033bf9f4914be321fc8f873a5aa.svg
Jakhongir Saydaliev
Jakh0103
user
Jakh0103
69b75d8291a28162b233fbb7
Dhia Garbaya
admin_assigned
2026-03-17T08:48:31.793Z
664c5e3ed13579bff431f4c8
https://cdn-avatars.huggingface.co/v1/production/uploads/664c5e3ed13579bff431f4c8/OSwdexHdSybqB4KJd-E5G.png
Dhia Garbaya
Dhia-GB
user
Dhia-GB
69b75d8291a28162b233fbb8
Michael Gastpar
69b75d8291a28162b233fbb9
Ashok Vardhan Makkuva
69b75d8291a28162b233fbba
Hyeji Kim
TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning
Large Reasoning Models (LRMs) achieve impressive performance on complex reasoning tasks via Chain-of-Thought (CoT) reasoning, which enables them to generate intermediate thinking tokens before arriving at the final answer. However, LRMs often suffer from significant overthinking, spending excessive compute time even after the answer is generated early on. Prior work has identified the existence of an optimal reasoning length such that truncating reasoning at this point significantly shortens CoT outputs with virtually no change in performance. However, determining optimal CoT lengths for practical datasets is highly non-trivial as they are fully task and model-dependent. In this paper, we precisely address this and design TERMINATOR, an early-exit strategy for LRMs at inference to mitigate overthinking. The central idea underpinning TERMINATOR is that the first arrival of an LRM's final answer is often predictable, and we leverage these first answer positions to create a novel dataset of optimal reasoning lengths to train TERMINATOR. Powered by this approach, TERMINATOR achieves significant reductions in CoT lengths of 14%-55% on average across four challenging practical datasets: MATH-500, AIME 2025, HumanEval, and GPQA, whilst outperforming current state-of-the-art methods.
TERMINATOR is an early-exit method for large reasoning models that reduces unnecessary computation by identifying optimal reasoning lengths for efficient chain-of-thought reasoning.
Chain-of-Thought large reasoning models overthinking early-exit strategy optimal reasoning length TERMINATOR