World Guidance: World Modeling in Condition Space for Action Generation
Leveraging future observation modeling to facilitate action generation presents a promising avenue for enhancing the capabilities of Vision-Language-Action (VLA) models. However, existing approaches struggle to strike a balance between maintaining efficient, predictable future representations and preserving sufficient fine-grained information to guide precise action generation. To address this limitation, we propose WoG (World Guidance), a framework that maps future observations into compact conditions by injecting them into the action inference pipeline. The VLA is then trained to simultaneously predict these compressed conditions alongside future actions, thereby achieving effective world modeling within the condition space for action inference. We demonstrate that modeling and predicting this condition space not only facilitates fine-grained action generation but also exhibits superior generalization capabilities. Moreover, it learns effectively from substantial human manipulation videos. Extensive experiments across both simulation and real-world environments validate that our method significantly outperforms existing methods based on future prediction. Project page is available at: https://selen-suyue.github.io/WoGNet/
699fb776ebfce7fbcca91adc
Yue Su
699fb776ebfce7fbcca91add
Sijin Chen
699fb776ebfce7fbcca91ade
Haixin Shi
699fb776ebfce7fbcca91adf
Mingyu Liu
699fb776ebfce7fbcca91ae0
Zhengshen Zhang
699fb776ebfce7fbcca91ae1
Ningyuan Huang
699fb776ebfce7fbcca91ae2
Weiheng Zhong
699fb776ebfce7fbcca91ae3
Zhengbang Zhu
699fb776ebfce7fbcca91ae4
Yuxiao Liu
claimed_verified
2026-03-03T10:43:14.478Z
6772383bb19143bfea926c92
/avatars/4dbaaa791a731543381455821924a265.svg
Yuxiao Liu
TopoInside
user
TopoInside
699fb776ebfce7fbcca91ae5
Xihui Liu
World Guidance: World Modeling in Condition Space for Action Generation
Leveraging future observation modeling to facilitate action generation presents a promising avenue for enhancing the capabilities of Vision-Language-Action (VLA) models. However, existing approaches struggle to strike a balance between maintaining efficient, predictable future representations and preserving sufficient fine-grained information to guide precise action generation. To address this limitation, we propose WoG (World Guidance), a framework that maps future observations into compact conditions by injecting them into the action inference pipeline. The VLA is then trained to simultaneously predict these compressed conditions alongside future actions, thereby achieving effective world modeling within the condition space for action inference. We demonstrate that modeling and predicting this condition space not only facilitates fine-grained action generation but also exhibits superior generalization capabilities. Moreover, it learns effectively from substantial human manipulation videos. Extensive experiments across both simulation and real-world environments validate that our method significantly outperforms existing methods based on future prediction. Project page is available at: https://selen-suyue.github.io/WoGNet/
World Guidance framework enhances Vision-Language-Action models by mapping future observations into compact conditions for improved action generation and generalization.
Vision-Language-Action models future observation modeling action generation world modeling condition space future prediction human manipulation videos