AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learning
Humans naturally adapt to diverse environments by learning underlying rules across worlds with different dynamics, observations, and reward structures. In contrast, existing agents typically demonstrate improvements via self-evolving within a single domain, implicitly assuming a fixed environment distribution. Cross-environment learning has remained largely unmeasured: there is no standard collection of controllable, heterogeneous environments, nor a unified way to represent how agents learn. We address these gaps in two steps. First, we propose AutoEnv, an automated framework that treats environments as factorizable distributions over transitions, observations, and rewards, enabling low-cost (4.12 USD on average) generation of heterogeneous worlds. Using AutoEnv, we construct AutoEnv-36, a dataset of 36 environments with 358 validated levels, on which seven language models achieve 12-49% normalized reward, demonstrating the challenge of AutoEnv-36. Second, we formalize agent learning as a component-centric process driven by three stages of Selection, Optimization, and Evaluation applied to an improvable agent component. Using this formulation, we design eight learning methods and evaluate them on AutoEnv-36. Empirically, the gain of any single learning method quickly decrease as the number of environments increases, revealing that fixed learning methods do not scale across heterogeneous environments. Environment-adaptive selection of learning methods substantially improves performance but exhibits diminishing returns as the method space expands. These results highlight both the necessity and the current limitations of agent learning for scalable cross-environment generalization, and position AutoEnv and AutoEnv-36 as a testbed for studying cross-environment agent learning. The code is avaiable at https://github.com/FoundationAgents/AutoEnv.
6925274e16eb3a9f13103998
Jiayi Zhang
claimed_verified
2025-11-25T09:05:29.887Z
65f40e83653c231cbaf7defe
/avatars/afa5ce72324112739e539865c9aee26b.svg
Jiayi Zhang
didiforhugface
user
didiforhugface
6925274e16eb3a9f13103999
Yiran Peng
6925274e16eb3a9f1310399a
Fanqi Kong
claimed_verified
2025-11-25T09:05:25.655Z
6621e02cf34ab6caed18e9c6
/avatars/15888b2060d1cc56be9fa55fd4b34005.svg
Fanqi Kong
Fancylalala
user
Fancylalala
6925274e16eb3a9f1310399b
Yang Cheng
claimed_verified
2025-11-25T09:05:18.820Z
67c443afb753bd020f9c97d8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/xbACBNLSopWmN5G1K8h_Y.png
Cheng
YangC777
user
YangC777
6925274e16eb3a9f1310399c
Yifan Wu
6925274e16eb3a9f1310399d
Zhaoyang Yu
6925274e16eb3a9f1310399e
Jinyu Xiang
claimed_verified
2025-11-25T09:05:23.607Z
649ea7106282cb41e77760bc
https://cdn-avatars.huggingface.co/v1/production/uploads/649ea7106282cb41e77760bc/HlWjaqxr03ob93vdKg_LQ.jpeg
Isaac
XiangJinYu
user
XiangJinYu
6925274e16eb3a9f1310399f
Jianhao Ruan
claimed_verified
2025-11-25T15:53:17.306Z
68a435cc22fdf7356962ccb9
/avatars/467f4732ade5f47b42433ff354acdeef.svg
jianhao ruan
Aurorra1123
user
Aurorra1123
6925274e16eb3a9f131039a0
Jinlin Wang
6925274e16eb3a9f131039a1
Maojia Song
6925274e16eb3a9f131039a2
HongZhang Liu
claimed_verified
2025-11-25T09:05:27.575Z
6632160088f75d987d1a156f
https://cdn-avatars.huggingface.co/v1/production/uploads/6632160088f75d987d1a156f/mYlMQfK1BGWeEbOSMmeSb.jpeg
Hongzhang Liu
Alphamasterliu
user
Alphamasterliu
6925274e16eb3a9f131039a3
Xiangru Tang
6925274e16eb3a9f131039a4
Bang Liu
6925274e16eb3a9f131039a5
Chenglin Wu
6925274e16eb3a9f131039a6
Yuyu Luo
AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learning
Humans naturally adapt to diverse environments by learning underlying rules across worlds with different dynamics, observations, and reward structures. In contrast, existing agents typically demonstrate improvements via self-evolving within a single domain, implicitly assuming a fixed environment distribution. Cross-environment learning has remained largely unmeasured: there is no standard collection of controllable, heterogeneous environments, nor a unified way to represent how agents learn. We address these gaps in two steps. First, we propose AutoEnv, an automated framework that treats environments as factorizable distributions over transitions, observations, and rewards, enabling low-cost (4.12 USD on average) generation of heterogeneous worlds. Using AutoEnv, we construct AutoEnv-36, a dataset of 36 environments with 358 validated levels, on which seven language models achieve 12-49% normalized reward, demonstrating the challenge of AutoEnv-36. Second, we formalize agent learning as a component-centric process driven by three stages of Selection, Optimization, and Evaluation applied to an improvable agent component. Using this formulation, we design eight learning methods and evaluate them on AutoEnv-36. Empirically, the gain of any single learning method quickly decrease as the number of environments increases, revealing that fixed learning methods do not scale across heterogeneous environments. Environment-adaptive selection of learning methods substantially improves performance but exhibits diminishing returns as the method space expands. These results highlight both the necessity and the current limitations of agent learning for scalable cross-environment generalization, and position AutoEnv and AutoEnv-36 as a testbed for studying cross-environment agent learning. The code is avaiable at https://github.com/FoundationAgents/AutoEnv.
AutoEnv and AutoEnv-36 provide a standardized framework and dataset for evaluating cross-environment learning in agents, highlighting the challenges and limitations of existing learning methods.
AutoEnv factorizable distributions heterogeneous environments AutoEnv-36 language models normalized reward component-centric process Selection Optimization Evaluation learning methods environment-adaptive selection