WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance
Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetitive errors and lack the ability to learn from past experiences across sessions, limiting their long-term robustness and sample efficiency. We introduce WebCoach, a model-agnostic self-evolving framework that equips web browsing agents with persistent cross-session memory, enabling improved long-term planning, reflection, and continual learning without retraining. WebCoach consists of three key components: (1) a WebCondenser, which standardizes raw navigation logs into concise summaries; (2) an External Memory Store, which organizes complete trajectories as episodic experiences; and (3) a Coach, which retrieves relevant experiences based on similarity and recency, and decides whether to inject task-specific advice into the agent via runtime hooks. This design empowers web agents to access long-term memory beyond their native context window, improving robustness in complex browsing tasks. Moreover, WebCoach achieves self-evolution by continuously curating episodic memory from new navigation trajectories, enabling agents to improve over time without retraining. Evaluations on the WebVoyager benchmark demonstrate that WebCoach consistently improves the performance of browser-use agents across three different LLM backbones. With a 38B model, it increases task success rates from 47% to 61% while reducing or maintaining the average number of steps. Notably, smaller base models with WebCoach achieve performance comparable to the same web agent using GPT-4o.
691bf7a86bfd5965c0fd3948
Genglin Liu
claimed_verified
2025-11-20T08:50:06.800Z
64881deb8e004bb92b0f4845
/avatars/30a1e016d469bf7eb42c713351a9f65c.svg
Genglin Liu
genglinliu
user
genglinliu
691bf7a86bfd5965c0fd3949
Shijie Geng
claimed_verified
2025-11-20T08:50:09.246Z
62130cc0581b98bb1ad00a9d
https://cdn-avatars.huggingface.co/v1/production/uploads/1672648250385-62130cc0581b98bb1ad00a9d.jpeg
Shijie Geng
makitanikaze
user
makitanikaze
691bf7a86bfd5965c0fd394a
Sha Li
691bf7a86bfd5965c0fd394b
Hejie Cui
691bf7a86bfd5965c0fd394c
Sarah Zhang
claimed_verified
2025-12-16T09:49:09.265Z
689f0979824b212c989170c7
/avatars/123b59892d939979ba68b5bb5b39a7c6.svg
Sarah Zhang
sjxzhang
user
sjxzhang
691bf7a86bfd5965c0fd394d
Xin Liu
691bf7a86bfd5965c0fd394e
Tianyi Liu
WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance
Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetitive errors and lack the ability to learn from past experiences across sessions, limiting their long-term robustness and sample efficiency. We introduce WebCoach, a model-agnostic self-evolving framework that equips web browsing agents with persistent cross-session memory, enabling improved long-term planning, reflection, and continual learning without retraining. WebCoach consists of three key components: (1) a WebCondenser, which standardizes raw navigation logs into concise summaries; (2) an External Memory Store, which organizes complete trajectories as episodic experiences; and (3) a Coach, which retrieves relevant experiences based on similarity and recency, and decides whether to inject task-specific advice into the agent via runtime hooks. This design empowers web agents to access long-term memory beyond their native context window, improving robustness in complex browsing tasks. Moreover, WebCoach achieves self-evolution by continuously curating episodic memory from new navigation trajectories, enabling agents to improve over time without retraining. Evaluations on the WebVoyager benchmark demonstrate that WebCoach consistently improves the performance of browser-use agents across three different LLM backbones. With a 38B model, it increases task success rates from 47% to 61% while reducing or maintaining the average number of steps. Notably, smaller base models with WebCoach achieve performance comparable to the same web agent using GPT-4o.