Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
AI agents may soon become capable of autonomously completing valuable, long-horizon tasks in diverse domains. Current benchmarks either do not measure real-world tasks, or are not sufficiently difficult to meaningfully measure frontier models. To this end, we present Terminal-Bench 2.0: a carefully curated hard benchmark composed of 89 tasks in computer terminal environments inspired by problems from real workflows. Each task features a unique environment, human-written solution, and comprehensive tests for verification. We show that frontier models and agents score less than 65\% on the benchmark and conduct an error analysis to identify areas for model and agent improvement. We publish the dataset and evaluation harness to assist developers and researchers in future work at https://www.tbench.ai/ .
6972e295fb12c92b735b7413
Mike A. Merrill
6972e295fb12c92b735b7414
Alexander G. Shaw
6972e295fb12c92b735b7415
Nicholas Carlini
6972e295fb12c92b735b7416
Boxuan Li
6972e295fb12c92b735b7417
Harsh Raj
6972e295fb12c92b735b7418
Ivan Bercovich
6972e295fb12c92b735b7419
Lin Shi
6972e295fb12c92b735b741a
Jeong Yeon Shin
6972e295fb12c92b735b741b
Thomas Walshe
6972e295fb12c92b735b741c
E. Kelly Buchanan
6972e295fb12c92b735b741d
Junhong Shen
6972e295fb12c92b735b741e
Guanghao Ye
6972e295fb12c92b735b741f
Haowei Lin
6972e295fb12c92b735b7420
Jason Poulos
6972e295fb12c92b735b7421
Maoyu Wang
6972e295fb12c92b735b7422
Marianna Nezhurina
6972e295fb12c92b735b7423
Jenia Jitsev
6972e295fb12c92b735b7424
Di Lu
claimed_verified
2026-01-26T08:32:49.008Z
6218528ee5157e7b2dea6a59
/avatars/44cf37f0a75bd1ae20cea0a86cc0d71b.svg
dylu
ludybupt
user
ludybupt
6972e295fb12c92b735b7425
Orfeas Menis Mastromichalakis
claimed_verified
2026-01-23T20:15:14.345Z
681c62df67484b747c2d6407
https://cdn-avatars.huggingface.co/v1/production/uploads/681c62df67484b747c2d6407/Qs-TOqeyqBMB2XHVhpQNG.jpeg
Orfeas Menis Mastromichalakis
menorf
user
menorf
6972e295fb12c92b735b7426
Zhiwei Xu
6972e295fb12c92b735b7427
Zizhao Chen
6972e295fb12c92b735b7428
Yue Liu
6972e295fb12c92b735b7429
Robert Zhang
claimed_verified
2026-02-17T15:50:02.820Z
68cdd3cef746a4f139673a17
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/-0kEWqxLMxiZTdMjswWlt.jpeg
Robert Zhang
0xrobertzhang
user
0xrobertzhang
6972e295fb12c92b735b742a
Leon Liangyu Chen
6972e295fb12c92b735b742b
Anurag Kashyap
6972e295fb12c92b735b742c
Jan-Lucas Uslu
6972e295fb12c92b735b742d
Jeffrey Li
6972e295fb12c92b735b742e
Jianbo Wu
claimed_verified
2026-01-29T21:17:14.264Z
6407d3d3a7bc7c3865addc4b
https://cdn-avatars.huggingface.co/v1/production/uploads/6407d3d3a7bc7c3865addc4b/PFCvfUSollUYmWL4p2vQM.jpeg
Jianbo Wu
jwu323
user
jwu323
6972e295fb12c92b735b742f
Minghao Yan
6972e295fb12c92b735b7430
Song Bian
6972e295fb12c92b735b7431
Vedang Sharma
6972e295fb12c92b735b7432
Ke Sun
6972e295fb12c92b735b7433
Steven Dillmann
6972e295fb12c92b735b7434
Akshay Anand
6972e295fb12c92b735b7435
Andrew Lanpouthakoun
6972e295fb12c92b735b7436
Bardia Koopah
6972e295fb12c92b735b7437
Changran Hu
6972e295fb12c92b735b7438
Etash Guha
6972e295fb12c92b735b7439
Gabriel H. S. Dreiman
6972e295fb12c92b735b743a
Jiacheng Zhu
6972e295fb12c92b735b743b
Karl Krauth
6972e295fb12c92b735b743c
Li Zhong
6972e295fb12c92b735b743d
Niklas Muennighoff
6972e295fb12c92b735b743e
Robert Amanfu
6972e295fb12c92b735b743f
Shangyin Tan
6972e295fb12c92b735b7440
Shreyas Pimpalgaonkar
6972e295fb12c92b735b7441
Tushar Aggarwal
6972e295fb12c92b735b7442
Xiangning Lin
6972e295fb12c92b735b7443
Xin Lan
claimed_verified
2026-02-23T09:47:45.452Z
699bdb709ccab2c085a650e8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/5gtzvDAQWMkMtj2qQBrEJ.png
Xin Lan
ShaneResearch
user
ShaneResearch
6972e295fb12c92b735b7444
Xuandong Zhao
claimed_verified
2026-01-26T08:32:51.756Z
6275a465597c70eb8949fce5
https://cdn-avatars.huggingface.co/v1/production/uploads/6275a465597c70eb8949fce5/ph4UogqMurMB0hSXZC38w.png
Xuandong Zhao
Xuandong
user
Xuandong
6972e295fb12c92b735b7445
Yiqing Liang
6972e295fb12c92b735b7446
Yuanli Wang
6972e295fb12c92b735b7447
Zilong Wang
6972e295fb12c92b735b7448
Changzhi Zhou
6972e295fb12c92b735b7449
David Heineman
claimed_verified
2026-04-17T07:00:27.647Z
6105c8136377c5f8ef2494b1
https://cdn-avatars.huggingface.co/v1/production/uploads/6105c8136377c5f8ef2494b1/mlifkrHYMhXlXSa9DFbDh.jpeg
David Heineman
davidheineman
user
davidheineman
6972e295fb12c92b735b744a
Hange Liu
6972e295fb12c92b735b744b
Harsh Trivedi
6972e295fb12c92b735b744c
John Yang
6972e295fb12c92b735b744d
Junhong Lin
claimed_verified
2026-02-19T09:54:10.773Z
6660de6a78c9d00c8d3bebfd
/avatars/77a77185e9e3d9a92ab5f35dfe76a1fc.svg
Junhong Lin
junhongmit
user
junhongmit
6972e295fb12c92b735b744e
Manish Shetty
6972e295fb12c92b735b744f
Michael Yang
6972e295fb12c92b735b7450
Nabil Omi
6972e295fb12c92b735b7451
Negin Raoof
6972e295fb12c92b735b7452
Shanda Li
6972e295fb12c92b735b7453
Terry Yue Zhuo
6972e295fb12c92b735b7454
Wuwei Lin
6972e295fb12c92b735b7455
Yiwei Dai
6972e295fb12c92b735b7456
Yuxin Wang
6972e295fb12c92b735b7457
Wenhao Chai
6972e295fb12c92b735b7458
Shang Zhou
6972e295fb12c92b735b7459
Dariush Wahdany
6972e295fb12c92b735b745a
Ziyu She
6972e295fb12c92b735b745b
Jiaming Hu
6972e295fb12c92b735b745c
Zhikang Dong
6972e295fb12c92b735b745d
Yuxuan Zhu
6972e295fb12c92b735b745e
Sasha Cui
6972e295fb12c92b735b745f
Ahson Saiyed
6972e295fb12c92b735b7460
Arinbjörn Kolbeinsson
6972e295fb12c92b735b7461
Jesse Hu
6972e295fb12c92b735b7462
Christopher Michael Rytting
6972e295fb12c92b735b7463
Ryan Marten
6972e295fb12c92b735b7464
Yixin Wang
6972e295fb12c92b735b7465
Alex Dimakis
6972e295fb12c92b735b7466
Andy Konwinski
6972e295fb12c92b735b7467
Ludwig Schmidt
Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
AI agents may soon become capable of autonomously completing valuable, long-horizon tasks in diverse domains. Current benchmarks either do not measure real-world tasks, or are not sufficiently difficult to meaningfully measure frontier models. To this end, we present Terminal-Bench 2.0: a carefully curated hard benchmark composed of 89 tasks in computer terminal environments inspired by problems from real workflows. Each task features a unique environment, human-written solution, and comprehensive tests for verification. We show that frontier models and agents score less than 65\% on the benchmark and conduct an error analysis to identify areas for model and agent improvement. We publish the dataset and evaluation harness to assist developers and researchers in future work at https://www.tbench.ai/ .
Terminal-Bench 2.0 presents a challenging benchmark with 89 terminal-based tasks to evaluate AI agents' capabilities in real-world scenarios.
AI agents long-horizon tasks benchmarks terminal environments real-world tasks evaluation harness