ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration
Large language models are powerful generalists, yet solving deep and complex problems such as those of the Humanity's Last Exam (HLE) remains both conceptually challenging and computationally expensive. We show that small orchestrators managing other models and a variety of tools can both push the upper bound of intelligence and improve efficiency in solving difficult agentic tasks. We introduce ToolOrchestra, a method for training small orchestrators that coordinate intelligent tools. ToolOrchestra explicitly uses reinforcement learning with outcome-, efficiency-, and user-preference-aware rewards. Using ToolOrchestra, we produce Orchestrator, an 8B model that achieves higher accuracy at lower cost than previous tool-use agents while aligning with user preferences on which tools are to be used for a given query. On HLE, Orchestrator achieves a score of 37.1%, outperforming GPT-5 (35.1%) while being 2.5x more efficient. On tau2-Bench and FRAMES, Orchestrator surpasses GPT-5 by a wide margin while using only about 30% of the cost. Extensive analysis shows that Orchestrator achieves the best trade-off between performance and cost under multiple metrics, and generalizes robustly to unseen tools. These results demonstrate that composing diverse tools with a lightweight orchestration model is both more efficient and more effective than existing methods, paving the way for practical and scalable tool-augmented reasoning systems.
692f11ffbfc6eea1b6fb6900
Hongjin Su
692f11ffbfc6eea1b6fb6901
Shizhe Diao
692f11ffbfc6eea1b6fb6902
Ximing Lu
692f11ffbfc6eea1b6fb6903
Mingjie Liu
692f11ffbfc6eea1b6fb6904
Jiacheng Xu
692f11ffbfc6eea1b6fb6905
Xin Dong
claimed_verified
2026-01-12T10:37:35.115Z
6092aaac134b77647f624bce
https://cdn-avatars.huggingface.co/v1/production/uploads/6092aaac134b77647f624bce/HGc1cJo7iOFJMKpZWrYJ0.jpeg
Xin Dong
SimonX
user
SimonX
692f11ffbfc6eea1b6fb6906
Yonggan Fu
692f11ffbfc6eea1b6fb6907
Peter Belcak
692f11ffbfc6eea1b6fb6908
Hanrong Ye
692f11ffbfc6eea1b6fb6909
Hongxu Yin
claimed_verified
2025-12-09T20:17:46.034Z
65a8b7f69aec1645994e7a15
/avatars/debc086f3fea029db22847bde80799a0.svg
Hongxu Yin
yinhongxu
user
yinhongxu
692f11ffbfc6eea1b6fb690a
Yi Dong
692f11ffbfc6eea1b6fb690b
Evelina Bakhturina
692f11ffbfc6eea1b6fb690c
Tao Yu
692f11ffbfc6eea1b6fb690d
Yejin Choi
692f11ffbfc6eea1b6fb690e
Jan Kautz
692f11ffbfc6eea1b6fb690f
Pavlo Molchanov
claimed_verified
2026-01-22T08:47:57.554Z
646d0c1c534e52f8c30500a6
https://cdn-avatars.huggingface.co/v1/production/uploads/646d0c1c534e52f8c30500a6/75VH8ClbRaP75BU2ONfXE.png
Pavlo Molchanov
pmolchanov
user
pmolchanov
ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration
Large language models are powerful generalists, yet solving deep and complex problems such as those of the Humanity's Last Exam (HLE) remains both conceptually challenging and computationally expensive. We show that small orchestrators managing other models and a variety of tools can both push the upper bound of intelligence and improve efficiency in solving difficult agentic tasks. We introduce ToolOrchestra, a method for training small orchestrators that coordinate intelligent tools. ToolOrchestra explicitly uses reinforcement learning with outcome-, efficiency-, and user-preference-aware rewards. Using ToolOrchestra, we produce Orchestrator, an 8B model that achieves higher accuracy at lower cost than previous tool-use agents while aligning with user preferences on which tools are to be used for a given query. On HLE, Orchestrator achieves a score of 37.1%, outperforming GPT-5 (35.1%) while being 2.5x more efficient. On tau2-Bench and FRAMES, Orchestrator surpasses GPT-5 by a wide margin while using only about 30% of the cost. Extensive analysis shows that Orchestrator achieves the best trade-off between performance and cost under multiple metrics, and generalizes robustly to unseen tools. These results demonstrate that composing diverse tools with a lightweight orchestration model is both more efficient and more effective than existing methods, paving the way for practical and scalable tool-augmented reasoning systems.
A small orchestrator using ToolOrchestra method coordinates various intelligent tools with reinforcement learning, achieving higher accuracy and efficiency in solving complex tasks like Humanity's Last Exam compared to larger models.
large language models ToolOrchestra reinforcement learning outcome-aware rewards efficiency-aware rewards user-preference-aware rewards Orchestrator tool-use agents humanity's last exam tau2-bench FRAMES tool-augmented reasoning systems