Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model
  Reasoning Ability in VibeThinker-1.5B
Challenging the prevailing consensus that small models inherently lack robust
reasoning, this report introduces VibeThinker-1.5B, a 1.5B-parameter dense
model developed via our Spectrum-to-Signal Principle (SSP). This challenges the
prevailing approach of scaling model parameters to enhance capabilities, as
seen in models like DeepSeek R1 (671B) and Kimi k2 (>1T). The SSP framework
first employs a Two-Stage Diversity-Exploring Distillation (SFT) to generate a
broad spectrum of solutions, followed by MaxEnt-Guided Policy Optimization (RL)
to amplify the correct signal. With a total training cost of only $7,800,
VibeThinker-1.5B demonstrates superior reasoning capabilities compared to
closed-source models like Magistral Medium and Claude Opus 4, and performs on
par with open-source models like GPT OSS-20B Medium. Remarkably, it surpasses
the 400x larger DeepSeek R1 on three math benchmarks: AIME24 (80.3 vs. 79.8),
AIME25 (74.4 vs. 70.0), and HMMT25 (50.4 vs. 41.7). This is a substantial
improvement over its base model (6.7, 4.3, and 0.6, respectively). On
LiveCodeBench V6, it scores 51.1, outperforming Magistral Medium's 50.3 and its
base model's 0.0. These findings demonstrate that small models can achieve
reasoning capabilities comparable to large models, drastically reducing
training and inference costs and thereby democratizing advanced AI research.
6912a1c7a644ba07c499c6e1
Sen Xu
claimed_verified
2025-11-11T19:44:27.021Z
67486775ed2e4d9e50fc9117
https://cdn-avatars.huggingface.co/v1/production/uploads/67486775ed2e4d9e50fc9117/WrCtPqY9X67ASbkUeloDF.jpeg
Sen Xu
SenXbjtu
user
SenXbjtu
6912a1c7a644ba07c499c6e2
Yi Zhou
claimed_verified
2025-11-11T19:44:32.245Z
6406991ec3ab325efa9b6732
/avatars/5ba29d9e25820c1172b5a98b078e416f.svg
DenseHub
YiZhouDenseHub
user
YiZhouDenseHub
6912a1c7a644ba07c499c6e3
Wei Wang
6912a1c7a644ba07c499c6e4
Jixin Min
claimed_verified
2025-11-12T12:21:33.041Z
6646fa14b096df5b522fd5f9
/avatars/98f67b6f8cb9776575916a2ba027f738.svg
MIN JIXIN
JIXIN0121
user
JIXIN0121
6912a1c7a644ba07c499c6e5
Zhibin Yin
claimed_verified
2025-11-11T19:44:34.446Z
64d1faaa1ed6649d70d1fa2f
/avatars/388ba18df077eaa8e16a89e59bf852fa.svg
YinZhiBin
YinZhiBin
user
YinZhiBin
6912a1c7a644ba07c499c6e6
Yingwei Dai
6912a1c7a644ba07c499c6e7
Shixi Liu
claimed_verified
2025-11-13T13:07:14.701Z
6422eba32f38c0a50cfdc77d
/avatars/0b1137ff258ba578c8b0e257a43716fa.svg
lsx
lsx666
user
lsx666
6912a1c7a644ba07c499c6e8
Lianyu Pang
claimed_verified
2025-11-12T12:21:31.027Z
636b5433d524b220830e7a61
/avatars/09e9b392a189195aa09b93fc17b70cc3.svg
pangly
pangly
user
pangly
6912a1c7a644ba07c499c6e9
Yirong Chen
6912a1c7a644ba07c499c6ea
Junlin Zhang
claimed_verified
2025-11-11T19:44:24.601Z
668b5090101353874ced73d0
/avatars/b2ec34a321890140e97ddd69884132a8.svg
junlin zhang
junlinzhang
user
junlinzhang
Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model
  Reasoning Ability in VibeThinker-1.5B
Challenging the prevailing consensus that small models inherently lack robust
reasoning, this report introduces VibeThinker-1.5B, a 1.5B-parameter dense
model developed via our Spectrum-to-Signal Principle (SSP). This challenges the
prevailing approach of scaling model parameters to enhance capabilities, as
seen in models like DeepSeek R1 (671B) and Kimi k2 (>1T). The SSP framework
first employs a Two-Stage Diversity-Exploring Distillation (SFT) to generate a
broad spectrum of solutions, followed by MaxEnt-Guided Policy Optimization (RL)
to amplify the correct signal. With a total training cost of only $7,800,
VibeThinker-1.5B demonstrates superior reasoning capabilities compared to
closed-source models like Magistral Medium and Claude Opus 4, and performs on
par with open-source models like GPT OSS-20B Medium. Remarkably, it surpasses
the 400x larger DeepSeek R1 on three math benchmarks: AIME24 (80.3 vs. 79.8),
AIME25 (74.4 vs. 70.0), and HMMT25 (50.4 vs. 41.7). This is a substantial
improvement over its base model (6.7, 4.3, and 0.6, respectively). On
LiveCodeBench V6, it scores 51.1, outperforming Magistral Medium's 50.3 and its
base model's 0.0. These findings demonstrate that small models can achieve
reasoning capabilities comparable to large models, drastically reducing
training and inference costs and thereby democratizing advanced AI research.
VibeThinker-1.5B, a 1.5B-parameter model using the Spectrum-to-Signal Principle, achieves superior reasoning capabilities compared to larger models at a significantly lower cost.
Spectrum-to-Signal Principle Two-Stage Diversity-Exploring Distillation MaxEnt-Guided Policy Optimization VibeThinker-1.5B DeepSeek R1 Kimi k2 Magistral Medium Claude Opus 4 GPT OSS-20B Medium AIME24 AIME25 HMMT25 LiveCodeBench V6