Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models
We introduce Youtu-LLM, a lightweight yet powerful language model that harmonizes high computational efficiency with native agentic intelligence. Unlike typical small models that rely on distillation, Youtu-LLM (1.96B) is pre-trained from scratch to systematically cultivate reasoning and planning capabilities. The key technical advancements are as follows: (1) Compact Architecture with Long-Context Support: Built on a dense Multi-Latent Attention (MLA) architecture with a novel STEM-oriented vocabulary, Youtu-LLM supports a 128k context window. This design enables robust long-context reasoning and state tracking within a minimal memory footprint, making it ideal for long-horizon agent and reasoning tasks. (2) Principled "Commonsense-STEM-Agent" Curriculum: We curated a massive corpus of approximately 11T tokens and implemented a multi-stage training strategy. By progressively shifting the pre-training data distribution from general commonsense to complex STEM and agentic tasks, we ensure the model acquires deep cognitive abilities rather than superficial alignment. (3) Scalable Agentic Mid-training: Specifically for the agentic mid-training, we employ diverse data construction schemes to synthesize rich and varied trajectories across math, coding, and tool-use domains. This high-quality data enables the model to internalize planning and reflection behaviors effectively. Extensive evaluations show that Youtu-LLM sets a new state-of-the-art for sub-2B LLMs. On general benchmarks, it achieves competitive performance against larger models, while on agent-specific tasks, it significantly surpasses existing SOTA baselines, demonstrating that lightweight models can possess strong intrinsic agentic capabilities.
6955d543832867f25352555d
Junru Lu
claimed_verified
2026-01-02T15:40:05.752Z
64ddbc3f1f2dad27e1a05ac1
/avatars/4fb2753b7998c8536bfd4780d3b10a6d.svg
Junrulu
Junrulu
user
Junrulu
6955d543832867f25352555e
Jiarui Qin
claimed_verified
2026-01-04T20:10:16.162Z
64181d03edc5a69a66959b8a
/avatars/ca1748bc8fe0742158d836302c4292c7.svg
JR QIN
qinjr
user
qinjr
6955d543832867f25352555f
Lingfeng Qiao
claimed_verified
2026-01-05T13:49:30.691Z
63e9df3746574e63a2cc55c5
/avatars/3d27ad1ccfa51387e4b97d02e13deb41.svg
Lingfeng Qiao
leafqiaoqiao
user
leafqiaoqiao
6955d543832867f253525560
Yinghui Li
claimed_verified
2026-03-23T11:02:21.758Z
692e96fd7bf6e835a968d7c6
/avatars/c18a79cb53df74434f2d04ba145fe980.svg
Yinghui Li
liyinghui1998
user
liyinghui1998
6955d543832867f253525561
Xinyi Dai
6955d543832867f253525562
Bo Ke
claimed_verified
2026-01-16T10:34:27.680Z
695b2e5996df6e77f6ec59fe
/avatars/669bc9483570ea0bd5c3f1feede27021.svg
boke
kbyran
user
kbyran
6955d543832867f253525563
Jianfeng He
6955d543832867f253525564
Ruizhi Qiao
6955d543832867f253525565
Di Yin
6955d543832867f253525566
Xing Sun
claimed_verified
2026-01-02T15:40:03.584Z
647401e50da364bd0d002f2a
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/vPuPn7EV092mLBOM2YZXd.png
XING SUN
tedsun
user
tedsun
6955d543832867f253525567
Yunsheng Wu
6955d543832867f253525568
Yinsong Liu
claimed_verified
2026-01-05T08:27:54.847Z
6959daf62da262f6caa6b3b9
/avatars/3986907912cd2d502570b8969b02abcc.svg
Yinsong Liu
Yinsongliu
user
Yinsongliu
6955d543832867f253525569
Shuangyin Liu
6955d543832867f25352556a
Mingkong Tang
6955d543832867f25352556b
Haodong Lin
claimed_verified
2026-01-04T20:10:14.209Z
68006d7f9c4da89b98b95d08
https://cdn-avatars.huggingface.co/v1/production/uploads/68006d7f9c4da89b98b95d08/3oFLjqEQ7kN4z4Hmura8C.jpeg
HaoDong Lin
linhaodong19
user
linhaodong19
6955d543832867f25352556c
Jiayi Kuang
6955d543832867f25352556d
Fanxu Meng
claimed_verified
2026-04-01T12:46:39.111Z
643f55d4ec817b766686438a
/avatars/0feb460432c92ab9ada0d417a7a38f6a.svg
mengfanxu
fxmeng
user
fxmeng
6955d543832867f25352556e
Xiaojuan Tang
6955d543832867f25352556f
Yunjia Xi
6955d543832867f253525570
Junjie Huang
6955d543832867f253525571
Haotong Yang
6955d543832867f253525572
Zhenyi Shen
claimed_verified
2026-01-02T15:40:01.810Z
641b31a4ec5b871c0bcd6932
/avatars/bad42279ad99918b0846053f2fa95ac8.svg
Zhenyi Shen
zen-E
user
zen-E
6955d543832867f253525573
Yangning Li
6955d543832867f253525574
Qianwen Zhang
6955d543832867f253525575
Yifei Yu
6955d543832867f253525576
Siyu An
claimed_verified
2026-01-19T14:33:52.793Z
6363ad21287b5ce02ed187ae
/avatars/9903cddc7330852fc6d8cf672cebcb56.svg
SiyuAn
moonlake
user
moonlake
6955d543832867f253525577
Junnan Dong
6955d543832867f253525578
Qiufeng Wang
6955d543832867f253525579
Jie Wang
6955d543832867f25352557a
Keyu Chen
6955d543832867f25352557b
Wei Wen
6955d543832867f25352557c
Taian Guo
6955d543832867f25352557d
Zhifeng Shen
6955d543832867f25352557e
Daohai Yu
6955d543832867f25352557f
Jiahao Li
6955d543832867f253525580
Ke Li
claimed_verified
2026-01-06T10:02:40.116Z
63280915eeee4dd858083092
/avatars/78347af4af42527d53e88d9969c5c934.svg
Ke Li
tristanli
user
tristanli
6955d543832867f253525581
Zongyi Li
6955d543832867f253525582
Xiaoyu Tan
claimed_verified
2026-01-05T08:27:56.978Z
637af0a7bdf7309aa6da1c36
https://cdn-avatars.huggingface.co/v1/production/uploads/637af0a7bdf7309aa6da1c36/NHZ-09otVCfbpXVxm8f-e.png
Xiaoyu Tan
WIlliam1900
user
WIlliam1900
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models
We introduce Youtu-LLM, a lightweight yet powerful language model that harmonizes high computational efficiency with native agentic intelligence. Unlike typical small models that rely on distillation, Youtu-LLM (1.96B) is pre-trained from scratch to systematically cultivate reasoning and planning capabilities. The key technical advancements are as follows: (1) Compact Architecture with Long-Context Support: Built on a dense Multi-Latent Attention (MLA) architecture with a novel STEM-oriented vocabulary, Youtu-LLM supports a 128k context window. This design enables robust long-context reasoning and state tracking within a minimal memory footprint, making it ideal for long-horizon agent and reasoning tasks. (2) Principled "Commonsense-STEM-Agent" Curriculum: We curated a massive corpus of approximately 11T tokens and implemented a multi-stage training strategy. By progressively shifting the pre-training data distribution from general commonsense to complex STEM and agentic tasks, we ensure the model acquires deep cognitive abilities rather than superficial alignment. (3) Scalable Agentic Mid-training: Specifically for the agentic mid-training, we employ diverse data construction schemes to synthesize rich and varied trajectories across math, coding, and tool-use domains. This high-quality data enables the model to internalize planning and reflection behaviors effectively. Extensive evaluations show that Youtu-LLM sets a new state-of-the-art for sub-2B LLMs. On general benchmarks, it achieves competitive performance against larger models, while on agent-specific tasks, it significantly surpasses existing SOTA baselines, demonstrating that lightweight models can possess strong intrinsic agentic capabilities.
Youtu-LLM is a lightweight language model optimized for computational efficiency and agentic intelligence through a compact architecture, STEM-focused training curriculum, and scalable mid-training strategies for planning and reasoning tasks.
Multi-Latent Attention (MLA) architecture STEM-oriented vocabulary 128k context window Commonsense-STEM-Agent Curriculum multi-stage training strategy agentic mid-training data construction schemes planning and reflection behaviors long-context reasoning state tracking agentic capabilities