GEBench: Benchmarking Image Generation Models as GUI Environments
Recent advancements in image generation models have enabled the prediction of future Graphical User Interface (GUI) states based on user instructions. However, existing benchmarks primarily focus on general domain visual fidelity, leaving the evaluation of state transitions and temporal coherence in GUI-specific contexts underexplored. To address this gap, we introduce GEBench, a comprehensive benchmark for evaluating dynamic interaction and temporal coherence in GUI generation. GEBench comprises 700 carefully curated samples spanning five task categories, covering both single-step interactions and multi-step trajectories across real-world and fictional scenarios, as well as grounding point localization. To support systematic evaluation, we propose GE-Score, a novel five-dimensional metric that assesses Goal Achievement, Interaction Logic, Content Consistency, UI Plausibility, and Visual Quality. Extensive evaluations on current models indicate that while they perform well on single-step transitions, they struggle significantly with maintaining temporal coherence and spatial grounding over longer interaction sequences. Our findings identify icon interpretation, text rendering, and localization precision as critical bottlenecks. This work provides a foundation for systematic assessment and suggests promising directions for future research toward building high-fidelity generative GUI environments. The code is available at: https://github.com/stepfun-ai/GEBench.
698ad8ac1b2dc6b37d61b275
Haodong Li
claimed_verified
2026-02-10T09:28:30.775Z
65ddea8b2d26e59a5a33330f
/avatars/3104ddafd6dda3c05ea9a771dbf2deeb.svg
li haodong
mickyhimself
user
mickyhimself
698ad8ac1b2dc6b37d61b276
Jingwei Wu
698ad8ac1b2dc6b37d61b277
Quan Sun
698ad8ac1b2dc6b37d61b278
Guopeng Li
698ad8ac1b2dc6b37d61b279
Juanxi Tian
claimed_verified
2026-02-10T09:04:13.048Z
670880950e79a8b46f7ff9dd
https://cdn-avatars.huggingface.co/v1/production/uploads/670880950e79a8b46f7ff9dd/hA1TLhwlQblkFsq8wLrkB.jpeg
Juanxi Tian
Juanxi
user
Juanxi
698ad8ac1b2dc6b37d61b27a
Huanyu Zhang
698ad8ac1b2dc6b37d61b27b
Yanlin Lai
698ad8ac1b2dc6b37d61b27c
Ruichuan An
698ad8ac1b2dc6b37d61b27d
Hongbo Peng
claimed_verified
2026-03-10T09:46:33.341Z
68106c88b924dd6c328889c2
/avatars/8accf835b711bffa2ea307158950ab33.svg
Hongbo Peng
M1chaelPeng
user
M1chaelPeng
698ad8ac1b2dc6b37d61b27e
Yuhong Dai
claimed_verified
2026-02-10T09:04:30.092Z
65d70e775e971572da16c05b
https://cdn-avatars.huggingface.co/v1/production/uploads/65d70e775e971572da16c05b/8Cv71Clfk_C7k6U4yI6ln.jpeg
Yuhong Dai
BroAlanTaps
user
BroAlanTaps
698ad8ac1b2dc6b37d61b27f
Chenxi Li
698ad8ac1b2dc6b37d61b280
Chunmei Qing
698ad8ac1b2dc6b37d61b281
Jia Wang
698ad8ac1b2dc6b37d61b282
Ziyang Meng
698ad8ac1b2dc6b37d61b283
Zheng Ge
698ad8ac1b2dc6b37d61b284
Xiangyu Zhang
698ad8ac1b2dc6b37d61b285
Daxin Jiang
GEBench: Benchmarking Image Generation Models as GUI Environments
Recent advancements in image generation models have enabled the prediction of future Graphical User Interface (GUI) states based on user instructions. However, existing benchmarks primarily focus on general domain visual fidelity, leaving the evaluation of state transitions and temporal coherence in GUI-specific contexts underexplored. To address this gap, we introduce GEBench, a comprehensive benchmark for evaluating dynamic interaction and temporal coherence in GUI generation. GEBench comprises 700 carefully curated samples spanning five task categories, covering both single-step interactions and multi-step trajectories across real-world and fictional scenarios, as well as grounding point localization. To support systematic evaluation, we propose GE-Score, a novel five-dimensional metric that assesses Goal Achievement, Interaction Logic, Content Consistency, UI Plausibility, and Visual Quality. Extensive evaluations on current models indicate that while they perform well on single-step transitions, they struggle significantly with maintaining temporal coherence and spatial grounding over longer interaction sequences. Our findings identify icon interpretation, text rendering, and localization precision as critical bottlenecks. This work provides a foundation for systematic assessment and suggests promising directions for future research toward building high-fidelity generative GUI environments. The code is available at: https://github.com/stepfun-ai/GEBench.
A new benchmark and evaluation metric are introduced for assessing temporal coherence and dynamic interaction in GUI generation models, revealing significant challenges in maintaining consistency over extended interaction sequences.
GUI generation temporal coherence dynamic interaction visual fidelity GUI-specific contexts GEBench GE-Score goal achievement interaction logic content consistency UI plausibility visual quality