From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence
Large language models (LLMs) have fundamentally transformed automated software development by enabling direct translation of natural language descriptions into functional code, driving commercial adoption through tools like Github Copilot (Microsoft), Cursor (Anysphere), Trae (ByteDance), and Claude Code (Anthropic). While the field has evolved dramatically from rule-based systems to Transformer-based architectures, achieving performance improvements from single-digit to over 95\% success rates on benchmarks like HumanEval. In this work, we provide a comprehensive synthesis and practical guide (a series of analytic and probing experiments) about code LLMs, systematically examining the complete model life cycle from data curation to post-training through advanced prompting paradigms, code pre-training, supervised fine-tuning, reinforcement learning, and autonomous coding agents. We analyze the code capability of the general LLMs (GPT-4, Claude, LLaMA) and code-specialized LLMs (StarCoder, Code LLaMA, DeepSeek-Coder, and QwenCoder), critically examining the techniques, design decisions, and trade-offs. Further, we articulate the research-practice gap between academic research (e.g., benchmarks and tasks) and real-world deployment (e.g., software-related code tasks), including code correctness, security, contextual awareness of large codebases, and integration with development workflows, and map promising research directions to practical needs. Last, we conduct a series of experiments to provide a comprehensive analysis of code pre-training, supervised fine-tuning, and reinforcement learning, covering scaling law, framework selection, hyperparameter sensitivity, model architectures, and dataset comparisons.
692e667137312eaa83fd8832
Jian Yang
claimed_verified
2025-12-04T08:49:34.886Z
64ccb9bfead94891d12aef42
/avatars/c54809d43d93d3f0766bd2555cecc4e3.svg
Yang Jian
CSJianYang
user
CSJianYang
692e667137312eaa83fd8833
Xianglong Liu
692e667137312eaa83fd8834
Weifeng Lv
692e667137312eaa83fd8835
Ken Deng
692e667137312eaa83fd8836
Shawn Guo
692e667137312eaa83fd8837
Lin Jing
692e667137312eaa83fd8838
Yizhi Li
claimed_verified
2026-04-07T08:50:02.048Z
6382252f54421460665ec501
https://cdn-avatars.huggingface.co/v1/production/uploads/6382252f54421460665ec501/gW9fev3T5QPcNq4f9hqB1.jpeg
Yizhi Li
yizhilll
user
yizhilll
692e667137312eaa83fd8839
Shark Liu
692e667137312eaa83fd883a
Xianzhen Luo
692e667137312eaa83fd883b
Yuyu Luo
692e667137312eaa83fd883c
Changzai Pan
692e667137312eaa83fd883d
Ensheng Shi
692e667137312eaa83fd883e
Yingshui Tan
692e667137312eaa83fd883f
Renshuai Tao
692e667137312eaa83fd8840
Jiajun Wu
claimed_verified
2025-12-02T08:39:36.195Z
66a8e2538407031e388c501f
/avatars/d16d51f7b1e111efd6d0985995b614be.svg
wjj
wuyuverse
user
wuyuverse
692e667137312eaa83fd8841
Xianjie Wu
692e667137312eaa83fd8842
Zhenhe Wu
692e667137312eaa83fd8843
Daoguang Zan
692e667137312eaa83fd8844
Chenchen Zhang
692e667137312eaa83fd8845
Wei Zhang
claimed_verified
2026-03-27T12:58:09.768Z
69c67b2fa994b07915a6e083
/avatars/3d0fd966df540d34095d2c84ce449180.svg
wei zhang
zwpride
user
zwpride
692e667137312eaa83fd8846
He Zhu
692e667137312eaa83fd8847
Terry Yue Zhuo
claimed_verified
2025-12-02T16:50:22.285Z
62b7fb545233925f253531c8
https://cdn-avatars.huggingface.co/v1/production/uploads/62b7fb545233925f253531c8/W50u2G1HK3EtUKHRU189V.jpeg
Terry Yue Zhuo
terryyz
user
terryyz
692e667137312eaa83fd8848
Kerui Cao
692e667137312eaa83fd8849
Xianfu Cheng
692e667137312eaa83fd884a
Jun Dong
692e667137312eaa83fd884b
Shengjie Fang
692e667137312eaa83fd884c
Zhiwei Fei
692e667137312eaa83fd884d
Xiangyuan Guan
692e667137312eaa83fd884e
Qipeng Guo
692e667137312eaa83fd884f
Zhiguang Han
692e667137312eaa83fd8850
Joseph James
692e667137312eaa83fd8851
Tianqi Luo
692e667137312eaa83fd8852
Renyuan Li
claimed_verified
2025-12-03T09:17:45.344Z
67f1037cd5f976f3d4777390
/avatars/c2c9dfbb3d82815dba511c3a54a1ef6b.svg
Ryan
RenyuanLi
user
RenyuanLi
692e667137312eaa83fd8853
Yuhang Li
692e667137312eaa83fd8854
Yiming Liang
claimed_verified
2026-01-07T09:28:30.016Z
6555e8d8a0c34cd61a6b9ce3
/avatars/71dc562cef4bd42f6b762f036357c800.svg
yimingliang
yimingliang
user
yimingliang
692e667137312eaa83fd8855
Congnan Liu
692e667137312eaa83fd8856
Jiaheng Liu
692e667137312eaa83fd8857
Qian Liu
692e667137312eaa83fd8858
Ruitong Liu
692e667137312eaa83fd8859
Tyler Loakman
claimed_verified
2025-12-08T08:35:39.645Z
634e94582cd84978c49089c1
/avatars/c41640cda7a8a76555e3410b67ef064a.svg
Tyler Loakman
tylerl404
user
tylerl404
692e667137312eaa83fd885a
Xiangxin Meng
692e667137312eaa83fd885b
Chuang Peng
692e667137312eaa83fd885c
Tianhao Peng
692e667137312eaa83fd885d
Jiajun Shi
692e667137312eaa83fd885e
Mingjie Tang
692e667137312eaa83fd885f
Boyang Wang
692e667137312eaa83fd8860
Haowen Wang
692e667137312eaa83fd8861
Yunli Wang
692e667137312eaa83fd8862
Fanglin Xu
claimed_verified
2025-12-05T15:15:03.333Z
668619ce7374cac565759731
https://cdn-avatars.huggingface.co/v1/production/uploads/668619ce7374cac565759731/tUtiyIQRGsMdq3HB2yYIL.jpeg
Fanglin Xu
Tswatery
user
Tswatery
692e667137312eaa83fd8863
Zihan Xu
692e667137312eaa83fd8864
Fei Yuan
692e667137312eaa83fd8865
Ge Zhang
claimed_verified
2025-12-02T08:39:34.025Z
638efcf4c67af472d316d424
/avatars/97a57859d7d87a3a8f1bb41d32a72bc2.svg
Ge Zhang
zhangysk
user
zhangysk
692e667137312eaa83fd8866
Jiayi Zhang
claimed_verified
2025-12-02T08:39:32.149Z
65f40e83653c231cbaf7defe
/avatars/afa5ce72324112739e539865c9aee26b.svg
Jiayi Zhang
didiforhugface
user
didiforhugface
692e667137312eaa83fd8867
Xinhao Zhang
692e667137312eaa83fd8868
Wangchunshu Zhou
692e667137312eaa83fd8869
Hualei Zhu
692e667137312eaa83fd886a
King Zhu
692e667137312eaa83fd886b
Brown Dai
692e667137312eaa83fd886c
Aishan Liu
692e667137312eaa83fd886d
Zhoujun Li
692e667137312eaa83fd886e
Chenghua Lin
692e667137312eaa83fd886f
Tianyu Liu
692e667137312eaa83fd8870
Chao Peng
claimed_verified
2025-12-08T08:33:30.883Z
64425a502f4abae43fc0446c
/avatars/7448a8d024813d8a20e09c162a189304.svg
Chao Peng
pengchao
user
pengchao
692e667137312eaa83fd8871
Kai Shen
692e667137312eaa83fd8872
Libo Qin
692e667137312eaa83fd8873
Shuangyong Song
692e667137312eaa83fd8874
Zizheng Zhan
692e667137312eaa83fd8875
Jiajun Zhang
claimed_verified
2026-01-13T15:46:03.515Z
660297295c467e8c06c684b0
/avatars/b721b512148ae118cd99464ae909bb3a.svg
zjj
zjj1233
user
zjj1233
692e667137312eaa83fd8876
Jie Zhang
692e667137312eaa83fd8877
Zhaoxiang Zhang
692e667137312eaa83fd8878
Bo Zheng
From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence
Large language models (LLMs) have fundamentally transformed automated software development by enabling direct translation of natural language descriptions into functional code, driving commercial adoption through tools like Github Copilot (Microsoft), Cursor (Anysphere), Trae (ByteDance), and Claude Code (Anthropic). While the field has evolved dramatically from rule-based systems to Transformer-based architectures, achieving performance improvements from single-digit to over 95\% success rates on benchmarks like HumanEval. In this work, we provide a comprehensive synthesis and practical guide (a series of analytic and probing experiments) about code LLMs, systematically examining the complete model life cycle from data curation to post-training through advanced prompting paradigms, code pre-training, supervised fine-tuning, reinforcement learning, and autonomous coding agents. We analyze the code capability of the general LLMs (GPT-4, Claude, LLaMA) and code-specialized LLMs (StarCoder, Code LLaMA, DeepSeek-Coder, and QwenCoder), critically examining the techniques, design decisions, and trade-offs. Further, we articulate the research-practice gap between academic research (e.g., benchmarks and tasks) and real-world deployment (e.g., software-related code tasks), including code correctness, security, contextual awareness of large codebases, and integration with development workflows, and map promising research directions to practical needs. Last, we conduct a series of experiments to provide a comprehensive analysis of code pre-training, supervised fine-tuning, and reinforcement learning, covering scaling law, framework selection, hyperparameter sensitivity, model architectures, and dataset comparisons.
A comprehensive guide to code LLMs, covering their lifecycle from data curation to deployment, including techniques, trade-offs, and research-practice gaps.
Transformer-based architectures HumanEval prompting paradigms code pre-training supervised fine-tuning reinforcement learning autonomous coding agents GPT-4 Claude LLaMA StarCoder Code LLaMA DeepSeek-Coder QwenCoder code correctness security contextual awareness software-related code tasks scaling law framework selection hyperparameter sensitivity model architectures dataset comparisons