daVinci-Dev: Agent-native Mid-training for Software Engineering
Recently, the frontier of Large Language Model (LLM) capabilities has shifted from single-turn code generation to agentic software engineering-a paradigm where models autonomously navigate, edit, and test complex repositories. While post-training methods have become the de facto approach for code agents, **agentic mid-training**-mid-training (MT) on large-scale data that mirrors authentic agentic workflows-remains critically underexplored due to substantial resource requirements, despite offering a more scalable path to instilling foundational agentic behaviors than relying solely on expensive reinforcement learning. A central challenge in realizing effective agentic mid-training is the distribution mismatch between static training data and the dynamic, feedback-rich environment of real development. To address this, we present a systematic study of agentic mid-training, establishing both the data synthesis principles and training methodology for effective agent development at scale. Central to our approach is **agent-native data**-supervision comprising two complementary types of trajectories: **contextually-native trajectories** that preserve the complete information flow an agent experiences, offering broad coverage and diversity; and **environmentally-native trajectories** collected from executable repositories where observations stem from actual tool invocations and test executions, providing depth and interaction authenticity. We verify the model's agentic capabilities on `SWE-Bench Verified`. We demonstrate our superiority over the previous open software engineering mid-training recipe `Kimi-Dev` under two post-training settings with an aligned base model and agentic scaffold, while using less than half mid-training tokens (73.1B). Besides relative advantage, our best performing 32B and 72B models achieve **56.1%** and **58.5%** resolution rates, respectively, which are ...
69785315026bdf0473116f6a
Ji Zeng
claimed_verified
2026-01-27T08:31:51.245Z
62dce08bb2c60f29c3d0a5da
https://cdn-avatars.huggingface.co/v1/production/uploads/62dce08bb2c60f29c3d0a5da/dFRFamdOyPbR1OxQC_qOV.png
Ji Zeng
stargazerzj
user
stargazerzj
69785315026bdf0473116f6b
Dayuan Fu
69785315026bdf0473116f6c
Tiantian Mi
69785315026bdf0473116f6d
Yumin Zhuang
claimed_verified
2026-01-28T11:31:06.285Z
6651f8441b1ce9f4a61a09ee
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/YM8m6_FLN_eF5PmqD7BfA.png
Zhuang Yumin
Astricaelus
user
Astricaelus
69785315026bdf0473116f6e
Yaxing Huang
admin_assigned
2026-01-27T14:00:30.220Z
6865e6b362fc5689c5e67733
/avatars/186f3d248791d961b0a810d5225167cc.svg
Yaxing Huang
Rookie-Noob-Newbie
user
Rookie-Noob-Newbie
69785315026bdf0473116f6f
Xuefeng Li
admin_assigned
2026-01-27T14:00:37.248Z
67638cc0d63e4b348e8a5fa3
https://cdn-avatars.huggingface.co/v1/production/uploads/67638cc0d63e4b348e8a5fa3/BZNlw1uTGUcumCrXKkerx.png
Xuefeng Li
drxuefeng
user
drxuefeng
69785315026bdf0473116f70
Lyumanshan Ye
69785315026bdf0473116f71
Muhang Xie
claimed_verified
2026-03-31T09:32:17.673Z
67b7f988462862d18db625cc
/avatars/aba4a89691b927d3ca95f387f3291a1a.svg
谢牧航
Midoria7
user
Midoria7
69785315026bdf0473116f72
Qishuo Hua
69785315026bdf0473116f73
Zhen Huang
69785315026bdf0473116f74
Mohan Jiang
admin_assigned
2026-01-27T14:00:23.438Z
66d01e4401f2a6b4cd93ad87
https://cdn-avatars.huggingface.co/v1/production/uploads/66d01e4401f2a6b4cd93ad87/qxEUHyO8WauOCLcHXfiOS.png
Mohan Jiang (SII)
mhjiang0408
user
mhjiang0408
69785315026bdf0473116f75
Hanning Wang
69785315026bdf0473116f76
Jifan Lin
admin_assigned
2026-01-27T14:00:57.029Z
66fa544c54f87b607fbffd2e
/avatars/94195dcda0eb68e8fd20d80718744697.svg
Jifan Lin
evanlin2570
user
evanlin2570
69785315026bdf0473116f77
Yang Xiao
claimed_verified
2026-01-28T11:31:08.388Z
6002c316698168af3bb9f4a6
https://cdn-avatars.huggingface.co/v1/production/uploads/6002c316698168af3bb9f4a6/M2J2QFCRc5RhYRoz7OuZN.png
yangxiao
YangXiao-nlp
user
YangXiao-nlp
69785315026bdf0473116f78
Jie Sun
69785315026bdf0473116f79
Yunze Wu
admin_assigned
2026-01-27T14:01:06.063Z
684faf712acd915b5afc055f
https://cdn-avatars.huggingface.co/v1/production/uploads/684faf712acd915b5afc055f/K7icmL08HxniWDgdph73i.jpeg
Yunze Wu
wyzmike
user
wyzmike
69785315026bdf0473116f7a
Pengfei Liu
daVinci-Dev: Agent-native Mid-training for Software Engineering
Recently, the frontier of Large Language Model (LLM) capabilities has shifted from single-turn code generation to agentic software engineering-a paradigm where models autonomously navigate, edit, and test complex repositories. While post-training methods have become the de facto approach for code agents, **agentic mid-training**-mid-training (MT) on large-scale data that mirrors authentic agentic workflows-remains critically underexplored due to substantial resource requirements, despite offering a more scalable path to instilling foundational agentic behaviors than relying solely on expensive reinforcement learning. A central challenge in realizing effective agentic mid-training is the distribution mismatch between static training data and the dynamic, feedback-rich environment of real development. To address this, we present a systematic study of agentic mid-training, establishing both the data synthesis principles and training methodology for effective agent development at scale. Central to our approach is **agent-native data**-supervision comprising two complementary types of trajectories: **contextually-native trajectories** that preserve the complete information flow an agent experiences, offering broad coverage and diversity; and **environmentally-native trajectories** collected from executable repositories where observations stem from actual tool invocations and test executions, providing depth and interaction authenticity. We verify the model's agentic capabilities on `SWE-Bench Verified`. We demonstrate our superiority over the previous open software engineering mid-training recipe `Kimi-Dev` under two post-training settings with an aligned base model and agentic scaffold, while using less than half mid-training tokens (73.1B). Besides relative advantage, our best performing 32B and 72B models achieve **56.1%** and **58.5%** resolution rates, respectively, which are ...
Agentic mid-training enables large language models to develop autonomous software engineering capabilities through specialized data synthesis techniques that bridge the gap between static training data and dynamic development environments.
Large Language Model agentic software engineering mid-training distribution mismatch agent-native data contextually-native trajectories environmentally-native trajectories SWE-Bench Verified Kimi-Dev resolution rates