AstroReason-Bench: Evaluating Unified Agentic Planning across Heterogeneous Space Planning Problems
Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded environments, leaving their performance in physics-constrained real-world domains underexplored. We introduce AstroReason-Bench, a comprehensive benchmark for evaluating agentic planning in Space Planning Problems (SPP), a family of high-stakes problems with heterogeneous objectives, strict physical constraints, and long-horizon decision-making. AstroReason-Bench integrates multiple scheduling regimes, including ground station communication and agile Earth observation, and provides a unified agent-oriented interaction protocol. Evaluating on a range of state-of-the-art open- and closed-source agentic LLM systems, we find that current agents substantially underperform specialized solvers, highlighting key limitations of generalist planning under realistic constraints. AstroReason-Bench offers a challenging and diagnostic testbed for future agentic research.
696d99113f1837bfb8970971
Weiyi Wang
claimed_verified
2026-01-20T09:41:09.504Z
677b9845a3e83cdb4e1515c6
https://cdn-avatars.huggingface.co/v1/production/uploads/677b9845a3e83cdb4e1515c6/MUDThZI_xhtYvxJI7MxxC.png
Wang Weiyi
kaupane
user
kaupane
696d99113f1837bfb8970972
Xinchi Chen
admin_assigned
2026-01-19T14:46:43.643Z
690d8fb50b398ae0a9aeeb51
/avatars/6ca9f3d08f12c316d3c37711dfd1b5de.svg
Xinchi Chen
dalstonchen
user
dalstonchen
696d99113f1837bfb8970973
Jingjing Gong
696d99113f1837bfb8970974
Xuanjing Huang
admin_assigned
2026-01-19T14:46:20.037Z
67f9c4ee171948c38302ae0f
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Cqb3ijr_sZkpLhEEEEybK.png
Xuanjing Huang
xjhuang
user
xjhuang
696d99113f1837bfb8970975
Xipeng Qiu
admin_assigned
2026-01-19T14:46:14.074Z
61457b8deff2c9fdb4de4988
https://cdn-avatars.huggingface.co/v1/production/uploads/1632381702899-61457b8deff2c9fdb4de4988.jpeg
Xipeng Qiu
xpqiu
user
xpqiu
AstroReason-Bench: Evaluating Unified Agentic Planning across Heterogeneous Space Planning Problems
Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded environments, leaving their performance in physics-constrained real-world domains underexplored. We introduce AstroReason-Bench, a comprehensive benchmark for evaluating agentic planning in Space Planning Problems (SPP), a family of high-stakes problems with heterogeneous objectives, strict physical constraints, and long-horizon decision-making. AstroReason-Bench integrates multiple scheduling regimes, including ground station communication and agile Earth observation, and provides a unified agent-oriented interaction protocol. Evaluating on a range of state-of-the-art open- and closed-source agentic LLM systems, we find that current agents substantially underperform specialized solvers, highlighting key limitations of generalist planning under realistic constraints. AstroReason-Bench offers a challenging and diagnostic testbed for future agentic research.
Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded environments, leaving their performance in physics-constrained real-world domains underexplored. We introduce AstroReason-Bench, a comprehensive benchmark for evaluating agentic planning in Space Planning Problems (SPP), a family of high-stakes problems with heterogeneous objectives, strict physical constraints, and long-horizon decision-making. AstroReason-Bench integrates multiple scheduling regimes, including ground station communication and agile Earth observation, and provides a unified agent-oriented interaction protocol. Evaluating on a range of state-of-the-art open- and closed-source agentic LLM systems, we find that current agents substantially underperform specialized solvers, highlighting key limitations of generalist planning under realistic constraints. AstroReason-Bench offers a challenging and diagnostic testbed for future agentic research.
agentic Large Language Models generalist planners symbolic environments weakly grounded environments physics-constrained domains Space Planning Problems heterogeneous objectives physical constraints long-horizon decision-making scheduling regimes ground station communication agile Earth observation agent-oriented interaction protocol specialized solvers diagnostic testbed