GEditBench v2: A Human-Aligned Benchmark for General Image Editing
Recent advances in image editing have enabled models to handle complex instructions with impressive realism. However, existing evaluation frameworks lag behind: current benchmarks suffer from narrow task coverage, while standard metrics fail to adequately capture visual consistency, i.e., the preservation of identity, structure and semantic coherence between edited and original images. To address these limitations, we introduce GEditBench v2, a comprehensive benchmark with 1,200 real-world user queries spanning 23 tasks, including a dedicated open-set category for unconstrained, out-of-distribution editing instructions beyond predefined tasks. Furthermore, we propose PVC-Judge, an open-source pairwise assessment model for visual consistency, trained via two novel region-decoupled preference data synthesis pipelines. Besides, we construct VCReward-Bench using expert-annotated preference pairs to assess the alignment of PVC-Judge with human judgments on visual consistency evaluation. Experiments show that our PVC-Judge achieves state-of-the-art evaluation performance among open-source models and even surpasses GPT-5.1 on average. Finally, by benchmarking 16 frontier editing models, we show that GEditBench v2 enables more human-aligned evaluation, revealing critical limitations of current models, and providing a reliable foundation for advancing precise image editing.
69cb300d22f9e9dce3fe1f14
Zhangqi Jiang
claimed_verified
2026-03-31T09:28:41.654Z
6456433baaaf85a98faaf5ac
/avatars/fe7aca55b828e22b2d6afcdff4e09bc7.svg
Zhangqi-Jiang
Jiangzhangqi
user
Jiangzhangqi
69cb300d22f9e9dce3fe1f15
Zheng Sun
69cb300d22f9e9dce3fe1f16
Xianfang Zeng
69cb300d22f9e9dce3fe1f17
Yufeng Yang
69cb300d22f9e9dce3fe1f18
Xuanyang Zhang
admin_assigned
2026-03-31T09:39:03.327Z
6675854966c4fa6d0cee4d50
/avatars/aa6041a97985078e82cc89bfbade9828.svg
xuanyang zhang
xuanyangz
user
xuanyangz
69cb300d22f9e9dce3fe1f19
Yongliang Wu
69cb300d22f9e9dce3fe1f1a
Wei Cheng
claimed_verified
2026-03-31T09:28:39.459Z
64b914c8ace99c0723ad83a9
https://cdn-avatars.huggingface.co/v1/production/uploads/64b914c8ace99c0723ad83a9/B4gxNByeVY_xaOcjwiN1j.jpeg
Wei Cheng
wchengad
user
wchengad
69cb300d22f9e9dce3fe1f1b
Gang Yu
69cb300d22f9e9dce3fe1f1c
Xu Yang
69cb300d22f9e9dce3fe1f1d
Bihan Wen
admin_assigned
2026-03-31T09:38:52.012Z
684f8d9ddcbb5718d3f3d0d1
/avatars/163f9bac5cd8efe0a8b4f1d4cdfa74d7.svg
Bihan Wen
Nirvaneer
user
Nirvaneer
GEditBench v2: A Human-Aligned Benchmark for General Image Editing
Recent advances in image editing have enabled models to handle complex instructions with impressive realism. However, existing evaluation frameworks lag behind: current benchmarks suffer from narrow task coverage, while standard metrics fail to adequately capture visual consistency, i.e., the preservation of identity, structure and semantic coherence between edited and original images. To address these limitations, we introduce GEditBench v2, a comprehensive benchmark with 1,200 real-world user queries spanning 23 tasks, including a dedicated open-set category for unconstrained, out-of-distribution editing instructions beyond predefined tasks. Furthermore, we propose PVC-Judge, an open-source pairwise assessment model for visual consistency, trained via two novel region-decoupled preference data synthesis pipelines. Besides, we construct VCReward-Bench using expert-annotated preference pairs to assess the alignment of PVC-Judge with human judgments on visual consistency evaluation. Experiments show that our PVC-Judge achieves state-of-the-art evaluation performance among open-source models and even surpasses GPT-5.1 on average. Finally, by benchmarking 16 frontier editing models, we show that GEditBench v2 enables more human-aligned evaluation, revealing critical limitations of current models, and providing a reliable foundation for advancing precise image editing.
A new benchmark and evaluation model for image editing are introduced to better assess visual consistency and human alignment in complex editing tasks.
GEditBench v2 PVC-Judge visual consistency region-decoupled preference data synthesis VCReward-Bench image editing human alignment evaluation performance