daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently
While Large Language Models (LLMs) excel at short-term tasks, scaling them to long-horizon agentic workflows remains challenging. The core bottleneck lies in the scarcity of training data that captures authentic long-dependency structures and cross-stage evolutionary dynamics--existing synthesis methods either confine to single-feature scenarios constrained by model distribution, or incur prohibitive human annotation costs, failing to provide scalable, high-quality supervision. We address this by reconceptualizing data synthesis through the lens of real-world software evolution. Our key insight: Pull Request (PR) sequences naturally embody the supervision signals for long-horizon learning. They decompose complex objectives into verifiable submission units, maintain functional coherence across iterations, and encode authentic refinement patterns through bug-fix histories. Building on this, we propose daVinci-Agency, which systematically mines structured supervision from chain-of-PRs through three interlocking mechanisms: (1) progressive task decomposition via continuous commits, (2) long-term consistency enforcement through unified functional objectives, and (3) verifiable refinement from authentic bug-fix trajectories. Unlike synthetic trajectories that treat each step independently, daVinci-Agency's PR-grounded structure inherently preserves the causal dependencies and iterative refinements essential for teaching persistent goal-directed behavior and enables natural alignment with project-level, full-cycle task modeling. The resulting trajectories are substantial--averaging 85k tokens and 116 tool calls--yet remarkably data-efficient: fine-tuning GLM-4.6 on 239 daVinci-Agency samples yields broad improvements across benchmarks, notably achieving a 47% relative gain on Toolathlon. Beyond benchmark performance, our analysis confirms...
6982cefe9084cb4f0ecb57a9
Mohan Jiang
claimed_verified
2026-02-04T12:27:54.679Z
66d01e4401f2a6b4cd93ad87
https://cdn-avatars.huggingface.co/v1/production/uploads/66d01e4401f2a6b4cd93ad87/qxEUHyO8WauOCLcHXfiOS.png
Mohan Jiang (SII)
mhjiang0408
user
mhjiang0408
6982cefe9084cb4f0ecb57aa
Dayuan Fu
6982cefe9084cb4f0ecb57ab
Junhao Shi
6982cefe9084cb4f0ecb57ac
Ji Zeng
claimed_verified
2026-02-04T12:27:51.423Z
62dce08bb2c60f29c3d0a5da
https://cdn-avatars.huggingface.co/v1/production/uploads/62dce08bb2c60f29c3d0a5da/dFRFamdOyPbR1OxQC_qOV.png
Ji Zeng
stargazerzj
user
stargazerzj
6982cefe9084cb4f0ecb57ad
Weiye Si
6982cefe9084cb4f0ecb57ae
Keyu Li
claimed_verified
2026-02-04T12:27:49.277Z
668e476520e499a0786ea56e
https://cdn-avatars.huggingface.co/v1/production/uploads/668e476520e499a0786ea56e/lnvd1_UWW9o9ddrR6ehwR.png
Keyu Li (SII)
weizhihao1
user
weizhihao1
6982cefe9084cb4f0ecb57af
Xuefeng Li
6982cefe9084cb4f0ecb57b0
Yang Xiao
6982cefe9084cb4f0ecb57b1
Wenjie Li
6982cefe9084cb4f0ecb57b2
Dequan Wang
6982cefe9084cb4f0ecb57b3
Pengfei Liu
daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently
While Large Language Models (LLMs) excel at short-term tasks, scaling them to long-horizon agentic workflows remains challenging. The core bottleneck lies in the scarcity of training data that captures authentic long-dependency structures and cross-stage evolutionary dynamics--existing synthesis methods either confine to single-feature scenarios constrained by model distribution, or incur prohibitive human annotation costs, failing to provide scalable, high-quality supervision. We address this by reconceptualizing data synthesis through the lens of real-world software evolution. Our key insight: Pull Request (PR) sequences naturally embody the supervision signals for long-horizon learning. They decompose complex objectives into verifiable submission units, maintain functional coherence across iterations, and encode authentic refinement patterns through bug-fix histories. Building on this, we propose daVinci-Agency, which systematically mines structured supervision from chain-of-PRs through three interlocking mechanisms: (1) progressive task decomposition via continuous commits, (2) long-term consistency enforcement through unified functional objectives, and (3) verifiable refinement from authentic bug-fix trajectories. Unlike synthetic trajectories that treat each step independently, daVinci-Agency's PR-grounded structure inherently preserves the causal dependencies and iterative refinements essential for teaching persistent goal-directed behavior and enables natural alignment with project-level, full-cycle task modeling. The resulting trajectories are substantial--averaging 85k tokens and 116 tool calls--yet remarkably data-efficient: fine-tuning GLM-4.6 on 239 daVinci-Agency samples yields broad improvements across benchmarks, notably achieving a 47% relative gain on Toolathlon. Beyond benchmark performance, our analysis confirms...
Large language models face challenges in long-horizon agentic workflows due to lack of authentic long-dependency training data, which is addressed by leveraging pull request sequences for structured supervision through progressive decomposition, consistency enforcement, and refinement from bug-fix histories.
Large Language Models long-horizon agentic workflows training data long-dependency structures cross-stage evolutionary dynamics data synthesis Pull Request sequences task decomposition functional coherence bug-fix histories daVinci-Agency continuous commits unified functional objectives verifiable refinement causal dependencies iterative refinements goal-directed behavior project-level task modeling Toolathlon