ClawBench: Can AI Agents Complete Everyday Online Tasks?
AI agents may be able to automate your inbox, but can they automate other routine aspects of your life? Everyday online tasks offer a realistic yet unsolved testbed for evaluating the next generation of AI agents. To this end, we introduce ClawBench, an evaluation framework of 153 simple tasks that people need to accomplish regularly in their lives and work, spanning 144 live platforms across 15 categories, from completing purchases and booking appointments to submitting job applications. These tasks require demanding capabilities beyond existing benchmarks, such as obtaining relevant information from user-provided documents, navigating multi-step workflows across diverse platforms, and write-heavy operations like filling in many detailed forms correctly. Unlike existing benchmarks that evaluate agents in offline sandboxes with static pages, ClawBench operates on production websites, preserving the full complexity, dynamic nature, and challenges of real-world web interaction. A lightweight interception layer captures and blocks only the final submission request, ensuring safe evaluation without real-world side effects. Our evaluations of 7 frontier models show that both proprietary and open-source models can complete only a small portion of these tasks. For example, Claude Sonnet 4.6 achieves only 33.3%. Progress on ClawBench brings us closer to AI agents that can function as reliable general-purpose assistants.
69d85bf879548974da9464df
Yuxuan Zhang
claimed_verified
2026-04-10T07:43:18.089Z
63b908d0e3c78740d8e950d0
/avatars/3e80075e92aebdfea712f70b00d5ec7d.svg
Yuxuan Zhang
Reacherx
user
Reacherx
69d85bf879548974da9464e0
Yubo Wang
69d85bf879548974da9464e1
Yipeng Zhu
69d85bf879548974da9464e2
Penghui Du
claimed_verified
2026-04-10T07:43:24.166Z
647076467fd7ecdbd0ea03b1
/avatars/6e090ea5f88977c6f70544175094c2a6.svg
Penghui Du
eternaldolphin
user
eternaldolphin
69d85bf879548974da9464e3
Junwen Miao
claimed_verified
2026-04-10T13:34:08.055Z
66de7d16c35391da431b55ca
https://cdn-avatars.huggingface.co/v1/production/uploads/66de7d16c35391da431b55ca/A3WmfTw7vY1EcXFnnGyo9.jpeg
Junwen Miao
meksamiao
user
meksamiao
69d85bf879548974da9464e4
Xuan Lu
69d85bf879548974da9464e5
Wendong Xu
claimed_verified
2026-04-10T13:34:09.800Z
65437ef98f84f869869cb698
https://cdn-avatars.huggingface.co/v1/production/uploads/65437ef98f84f869869cb698/xRFcyXwQq7szB-GfAeoHu.png
Wendong XU
kirailol
user
kirailol
69d85bf879548974da9464e6
Yunzhuo Hao
69d85bf879548974da9464e7
Songcheng Cai
claimed_verified
2026-04-13T07:33:56.113Z
670d7aed372cb8fadbd270bb
/avatars/652c8b90d492e3e5db6c735d69ae0991.svg
Songcheng Cai
SongchengCai
user
SongchengCai
69d85bf879548974da9464e8
Xiaochen Wang
69d85bf879548974da9464e9
Huaisong Zhang
69d85bf879548974da9464ea
Xian Wu
69d85bf879548974da9464eb
Yi Lu
claimed_verified
2026-04-10T13:34:11.615Z
65095591cc02352e1e106d0a
https://cdn-avatars.huggingface.co/v1/production/uploads/65095591cc02352e1e106d0a/QgNhKBItxxHY927pBVBai.jpeg
Tom Lu
eigentom
user
eigentom
69d85bf879548974da9464ec
Minyi Lei
69d85bf879548974da9464ed
Kai Zou
69d85bf879548974da9464ee
Huifeng Yin
69d85bf879548974da9464ef
Ping Nie
claimed_verified
2026-04-13T07:33:44.870Z
65358802a920f38780b3248a
/avatars/9415510b598079973c2b0436ad12db9c.svg
Ping Nie
pingnieuk
user
pingnieuk
69d85bf879548974da9464f0
Liang Chen
69d85bf879548974da9464f1
Dongfu Jiang
69d85bf879548974da9464f2
Wenhu Chen
69d85bf879548974da9464f3
Kelsey R. Allen
ClawBench: Can AI Agents Complete Everyday Online Tasks?
AI agents may be able to automate your inbox, but can they automate other routine aspects of your life? Everyday online tasks offer a realistic yet unsolved testbed for evaluating the next generation of AI agents. To this end, we introduce ClawBench, an evaluation framework of 153 simple tasks that people need to accomplish regularly in their lives and work, spanning 144 live platforms across 15 categories, from completing purchases and booking appointments to submitting job applications. These tasks require demanding capabilities beyond existing benchmarks, such as obtaining relevant information from user-provided documents, navigating multi-step workflows across diverse platforms, and write-heavy operations like filling in many detailed forms correctly. Unlike existing benchmarks that evaluate agents in offline sandboxes with static pages, ClawBench operates on production websites, preserving the full complexity, dynamic nature, and challenges of real-world web interaction. A lightweight interception layer captures and blocks only the final submission request, ensuring safe evaluation without real-world side effects. Our evaluations of 7 frontier models show that both proprietary and open-source models can complete only a small portion of these tasks. For example, Claude Sonnet 4.6 achieves only 33.3%. Progress on ClawBench brings us closer to AI agents that can function as reliable general-purpose assistants.
ClawBench presents a comprehensive evaluation framework with 153 real-world tasks across 144 platforms to test AI agents' ability to automate everyday online activities requiring complex multi-step workflows and document processing.
AI agents evaluation framework online tasks real-world web interaction multi-step workflows document processing