Towards a Science of Scaling Agent Systems
Agents, language model (LM)-based systems that are capable of reasoning, planning, and acting are becoming the dominant paradigm for real-world AI applications. Despite this widespread adoption, the principles that determine their performance remain underexplored, leaving practitioners to rely on heuristics rather than principled design choices. We address this gap by deriving quantitative scaling principles for agent systems. We evaluate this across four diverse benchmarks: Finance-Agent, BrowseComp-Plus, PlanCraft, and Workbench. Using five canonical architectures (Single, Independent, Centralized, Decentralized, Hybrid) instantiated across three LLM families, we perform a controlled evaluation spanning 180 configurations with standardized tools and token budgets. We derive a predictive model using empirical coordination metrics, including efficiency, overhead, error amplification, and redundancy, that achieves cross-validated R^2=0.513. We identify three dominant effects: (1) a tool-coordination trade-off: under fixed computational budgets, tool-heavy tasks suffer disproportionately from multi-agent overhead. (2) a capability saturation: coordination yields diminishing or negative returns (beta=-0.408, p<0.001) once single-agent baselines exceed ~45%. (3) topology-dependent error amplification: independent agents amplify errors 17.2x through unchecked propagation, while centralized coordination contains this to 4.4x. Centralized coordination improves performance by 80.9% on parallelizable tasks like financial reasoning, while decentralized coordination excels on dynamic web navigation (+9.2% vs. +0.2%). Yet for sequential reasoning tasks, all multi-agent variants degraded performance by 39-70%. The framework predicts the optimal coordination strategy for 87% of held-out configurations, providing a predictive principle of agentic scaling based on measurable task properties.
693aad7ee1612ff4bc2a4946
Yubin Kim
693aad7ee1612ff4bc2a4947
Ken Gu
693aad7ee1612ff4bc2a4948
Chanwoo Park
693aad7ee1612ff4bc2a4949
Chunjong Park
693aad7ee1612ff4bc2a494a
Samuel Schmidgall
693aad7ee1612ff4bc2a494b
A. Ali Heydari
693aad7ee1612ff4bc2a494c
Yao Yan
693aad7ee1612ff4bc2a494d
Zhihan Zhang
693aad7ee1612ff4bc2a494e
Yuchen Zhuang
693aad7ee1612ff4bc2a494f
Mark Malhotra
693aad7ee1612ff4bc2a4950
Paul Pu Liang
693aad7ee1612ff4bc2a4951
Hae Won Park
693aad7ee1612ff4bc2a4952
Yuzhe Yang
claimed_verified
2026-02-17T15:49:20.311Z
6992d7b1ce360fb90a7c890a
https://cdn-avatars.huggingface.co/v1/production/uploads/6992d7b1ce360fb90a7c890a/22YNfzoS_9L9D1FP3R_es.jpeg
Yuzhe Yang
yuzhe-yang
user
yuzhe-yang
693aad7ee1612ff4bc2a4953
Xuhai Xu
693aad7ee1612ff4bc2a4954
Yilun Du
693aad7ee1612ff4bc2a4955
Shwetak Patel
693aad7ee1612ff4bc2a4956
Tim Althoff
693aad7ee1612ff4bc2a4957
Daniel McDuff
693aad7ee1612ff4bc2a4958
Xin Liu
Towards a Science of Scaling Agent Systems
Agents, language model (LM)-based systems that are capable of reasoning, planning, and acting are becoming the dominant paradigm for real-world AI applications. Despite this widespread adoption, the principles that determine their performance remain underexplored, leaving practitioners to rely on heuristics rather than principled design choices. We address this gap by deriving quantitative scaling principles for agent systems. We evaluate this across four diverse benchmarks: Finance-Agent, BrowseComp-Plus, PlanCraft, and Workbench. Using five canonical architectures (Single, Independent, Centralized, Decentralized, Hybrid) instantiated across three LLM families, we perform a controlled evaluation spanning 180 configurations with standardized tools and token budgets. We derive a predictive model using empirical coordination metrics, including efficiency, overhead, error amplification, and redundancy, that achieves cross-validated R^2=0.513. We identify three dominant effects: (1) a tool-coordination trade-off: under fixed computational budgets, tool-heavy tasks suffer disproportionately from multi-agent overhead. (2) a capability saturation: coordination yields diminishing or negative returns (beta=-0.408, p<0.001) once single-agent baselines exceed ~45%. (3) topology-dependent error amplification: independent agents amplify errors 17.2x through unchecked propagation, while centralized coordination contains this to 4.4x. Centralized coordination improves performance by 80.9% on parallelizable tasks like financial reasoning, while decentralized coordination excels on dynamic web navigation (+9.2% vs. +0.2%). Yet for sequential reasoning tasks, all multi-agent variants degraded performance by 39-70%. The framework predicts the optimal coordination strategy for 87% of held-out configurations, providing a predictive principle of agentic scaling based on measurable task properties.
A quantitative framework for agent system scaling using empirical coordination metrics identifies optimal multi-agent strategies based on task properties.
agent systems language model (LM) reasoning planning acting quantitative scaling principles Finance-Agent BrowseComp-Plus PlanCraft Workbench Single Independent Centralized Decentralized Hybrid LLM families coordination metrics efficiency overhead error amplification redundancy predictive model tool-coordination trade-off capability saturation topology-dependent error amplification centralized coordination decentralized coordination sequential reasoning tasks agentic scaling