Beyond Static Tools: Test-Time Tool Evolution for Scientific Reasoning
The central challenge of AI for Science is not reasoning alone, but the ability to create computational methods in an open-ended scientific world. Existing LLM-based agents rely on static, pre-defined tool libraries, a paradigm that fundamentally fails in scientific domains where tools are sparse, heterogeneous, and intrinsically incomplete. In this paper, we propose Test-Time Tool Evolution (TTE), a new paradigm that enables agents to synthesize, verify, and evolve executable tools during inference. By transforming tools from fixed resources into problem-driven artifacts, TTE overcomes the rigidity and long-tail limitations of static tool libraries. To facilitate rigorous evaluation, we introduce SciEvo, a benchmark comprising 1,590 scientific reasoning tasks supported by 925 automatically evolved tools. Extensive experiments show that TTE achieves state-of-the-art performance in both accuracy and tool efficiency, while enabling effective cross-domain adaptation of computational tools. The code and benchmark have been released at https://github.com/lujiaxuan0520/Test-Time-Tool-Evol.
696745d2c5e371f6b235d1f1
Jiaxuan Lu
admin_assigned
2026-01-16T15:34:53.789Z
67e655f7d6b8333a8f78eadf
/avatars/11cc80d3c03747fd869e4dc1dbdd031a.svg
Jiaxuan Lu
Blue-Giant
user
Blue-Giant
696745d2c5e371f6b235d1f2
Ziyu Kong
admin_assigned
2026-01-16T15:34:59.511Z
65617bf9f5532ac1bde64d07
/avatars/6659fe26eecfce8ac699caa73b823fe1.svg
ZIYU KONG
ziyukong
user
ziyukong
696745d2c5e371f6b235d1f3
Yemin Wang
claimed_verified
2026-01-22T08:47:36.389Z
6971caaa5a5aadea5d915daf
/avatars/697d706b64355d1c44e48230545c0f43.svg
Yemin Wang
YeminWang
user
YeminWang
696745d2c5e371f6b235d1f4
Rong Fu
claimed_verified
2026-01-20T14:48:21.597Z
6969f6a4c6f6908a03db3c8f
/avatars/2841056cff7ec8b684bc9c3eee0aa8ca.svg
Rong Fu
furonglegend
user
furonglegend
696745d2c5e371f6b235d1f5
Haiyuan Wan
claimed_verified
2026-01-16T10:33:47.426Z
691b0f528411a45dc9ee9de8
/avatars/261c28f7e616a8482970f50c1f8919fd.svg
Haiyuan Wan
HY-Wan
user
HY-Wan
696745d2c5e371f6b235d1f6
Cheng Yang
claimed_verified
2026-01-16T10:33:18.927Z
67c443afb753bd020f9c97d8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/xbACBNLSopWmN5G1K8h_Y.png
Cheng
YangC777
user
YangC777
696745d2c5e371f6b235d1f7
Wenjie Lou
696745d2c5e371f6b235d1f8
Haoran Sun
696745d2c5e371f6b235d1f9
Lilong Wang
admin_assigned
2026-01-16T15:35:20.390Z
67fc7887864dfcbd93ce6322
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/1ecRk5ZWDXALss7e4fjtQ.png
Lilong Wang
Eason2025
user
Eason2025
696745d2c5e371f6b235d1fa
Yankai Jiang
admin_assigned
2026-01-16T15:35:26.741Z
671280b9a895018bbc281dea
/avatars/55f3c2d3698011bc718ec18295519caa.svg
Yankai Jiang
yankaijiang
user
yankaijiang
696745d2c5e371f6b235d1fb
Xiaosong Wang
696745d2c5e371f6b235d1fc
Xiao Sun
696745d2c5e371f6b235d1fd
Dongzhan Zhou
admin_assigned
2026-01-16T15:35:36.629Z
6538b861613fe158bd581e35
/avatars/6817dbfe903675721fd227058b0a91ac.svg
Dongzhan Zhou
schrodingers-tiger
user
schrodingers-tiger
Beyond Static Tools: Test-Time Tool Evolution for Scientific Reasoning
The central challenge of AI for Science is not reasoning alone, but the ability to create computational methods in an open-ended scientific world. Existing LLM-based agents rely on static, pre-defined tool libraries, a paradigm that fundamentally fails in scientific domains where tools are sparse, heterogeneous, and intrinsically incomplete. In this paper, we propose Test-Time Tool Evolution (TTE), a new paradigm that enables agents to synthesize, verify, and evolve executable tools during inference. By transforming tools from fixed resources into problem-driven artifacts, TTE overcomes the rigidity and long-tail limitations of static tool libraries. To facilitate rigorous evaluation, we introduce SciEvo, a benchmark comprising 1,590 scientific reasoning tasks supported by 925 automatically evolved tools. Extensive experiments show that TTE achieves state-of-the-art performance in both accuracy and tool efficiency, while enabling effective cross-domain adaptation of computational tools. The code and benchmark have been released at https://github.com/lujiaxuan0520/Test-Time-Tool-Evol.
Test-Time Tool Evolution enables AI agents to dynamically create and refine computational tools during inference, overcoming limitations of static tool libraries in scientific applications.
LLM-based agents tool libraries scientific reasoning computational methods test-time tool evolution SciEvo benchmark tool synthesis tool verification tool evolution cross-domain adaptation