AgentIF-OneDay: A Task-level Instruction-Following Benchmark for General AI Agents in Daily Scenarios
The capacity of AI agents to effectively handle tasks of increasing duration and complexity continues to grow, demonstrating exceptional performance in coding, deep research, and complex problem-solving evaluations. However, in daily scenarios, the perception of these advanced AI capabilities among general users remains limited. We argue that current evaluations prioritize increasing task difficulty without sufficiently addressing the diversity of agentic tasks necessary to cover the daily work, life, and learning activities of a broad demographic. To address this, we propose AgentIF-OneDay, aimed at determining whether general users can utilize natural language instructions and AI agents to complete a diverse array of daily tasks. These tasks require not only solving problems through dialogue but also understanding various attachment types and delivering tangible file-based results. The benchmark is structured around three user-centric categories: Open Workflow Execution, which assesses adherence to explicit and complex workflows; Latent Instruction, which requires agents to infer implicit instructions from attachments; and Iterative Refinement, which involves modifying or expanding upon ongoing work. We employ instance-level rubrics and a refined evaluation pipeline that aligns LLM-based verification with human judgment, achieving an 80.1% agreement rate using Gemini-3-Pro. AgentIF-OneDay comprises 104 tasks covering 767 scoring points. We benchmarked four leading general AI agents and found that agent products built based on APIs and ChatGPT agents based on agent RL remain in the first tier simultaneously. Leading LLM APIs and open-source models have internalized agentic capabilities, enabling AI application teams to develop cutting-edge Agent products.
697b7fb501afa04094ca0877
Kaiyuan Chen
697b7fb501afa04094ca0878
Qimin Wu
697b7fb501afa04094ca0879
Taiyu Hou
697b7fb501afa04094ca087a
Tianhao Tang
697b7fb501afa04094ca087b
Xueyu Hu
697b7fb501afa04094ca087c
Yuchen Hou
697b7fb501afa04094ca087d
Bikun Li
697b7fb501afa04094ca087e
Chengming Qian
697b7fb501afa04094ca087f
Guoyin Wang
697b7fb501afa04094ca0880
Haolin Chen
697b7fb501afa04094ca0881
Haotong Tian
697b7fb501afa04094ca0882
Haoye Zhang
697b7fb501afa04094ca0883
Haoyu Bian
697b7fb501afa04094ca0884
Hongbing Pan
697b7fb501afa04094ca0885
Hongkang Zhang
697b7fb501afa04094ca0886
Hongyi Zhou
697b7fb501afa04094ca0887
Jiaqi Cai
697b7fb501afa04094ca0888
Jiewu Rao
697b7fb501afa04094ca0889
Jiyuan Ren
697b7fb501afa04094ca088a
Keduan Huang
697b7fb501afa04094ca088b
Lucia Zhu Huang
697b7fb501afa04094ca088c
Mingyu Yuan
697b7fb501afa04094ca088d
Naixu Guo
697b7fb501afa04094ca088e
Qicheng Tang
697b7fb501afa04094ca088f
Qinyan Zhang
697b7fb501afa04094ca0890
Shuai Chen
697b7fb501afa04094ca0891
Siheng Chen
697b7fb501afa04094ca0892
Ting Ting Li
697b7fb501afa04094ca0893
Xiaoxing Guo
697b7fb501afa04094ca0894
Yaocheng Zuo
697b7fb501afa04094ca0895
Yaoqi Guo
697b7fb501afa04094ca0896
Yinan Wang
697b7fb501afa04094ca0897
Yinzhou Yu
697b7fb501afa04094ca0898
Yize Wang
697b7fb501afa04094ca0899
Yuan Jiang
697b7fb501afa04094ca089a
Yuan Tian
697b7fb501afa04094ca089b
Yuanshuo Zhang
claimed_verified
2026-02-03T10:08:59.560Z
65e826cd75898c50f3322b22
/avatars/9f7a9cfece29b761c71342167cedcbaf.svg
Yuanshuo Zhang
YuanshuoZhang
user
YuanshuoZhang
697b7fb501afa04094ca089c
Yuxuan Liu
697b7fb501afa04094ca089d
Yvette Yan Zeng
697b7fb501afa04094ca089e
Zenyu Shan
697b7fb501afa04094ca089f
Zihan Yin
697b7fb501afa04094ca08a0
Xiaobo Hu
697b7fb501afa04094ca08a1
Yang Liu
697b7fb501afa04094ca08a2
Yixin Ren
697b7fb501afa04094ca08a3
Yuan Gong
AgentIF-OneDay: A Task-level Instruction-Following Benchmark for General AI Agents in Daily Scenarios
The capacity of AI agents to effectively handle tasks of increasing duration and complexity continues to grow, demonstrating exceptional performance in coding, deep research, and complex problem-solving evaluations. However, in daily scenarios, the perception of these advanced AI capabilities among general users remains limited. We argue that current evaluations prioritize increasing task difficulty without sufficiently addressing the diversity of agentic tasks necessary to cover the daily work, life, and learning activities of a broad demographic. To address this, we propose AgentIF-OneDay, aimed at determining whether general users can utilize natural language instructions and AI agents to complete a diverse array of daily tasks. These tasks require not only solving problems through dialogue but also understanding various attachment types and delivering tangible file-based results. The benchmark is structured around three user-centric categories: Open Workflow Execution, which assesses adherence to explicit and complex workflows; Latent Instruction, which requires agents to infer implicit instructions from attachments; and Iterative Refinement, which involves modifying or expanding upon ongoing work. We employ instance-level rubrics and a refined evaluation pipeline that aligns LLM-based verification with human judgment, achieving an 80.1% agreement rate using Gemini-3-Pro. AgentIF-OneDay comprises 104 tasks covering 767 scoring points. We benchmarked four leading general AI agents and found that agent products built based on APIs and ChatGPT agents based on agent RL remain in the first tier simultaneously. Leading LLM APIs and open-source models have internalized agentic capabilities, enabling AI application teams to develop cutting-edge Agent products.
AgentIF-OneDay evaluates AI agents' ability to handle diverse daily tasks through natural language instructions, requiring problem-solving, attachment understanding, and file-based outputs across three user-centric categories.
AI agents natural language instructions agent-based evaluation Open Workflow Execution Latent Instruction Iterative Refinement LLM-based verification human judgment alignment agent RL API-based agents ChatGPT agents LLM APIs open-source models agentic capabilities