Visual-ERM: Reward Modeling for Visual Equivalence
Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs) achieve strong results via supervised fine-tuning, reinforcement learning remains challenging due to misaligned reward signals. Existing rewards either rely on textual rules or coarse visual embedding similarity, both of which fail to capture fine-grained visual discrepancies and are vulnerable to reward hacking. We propose Visual Equivalence Reward Model (Visual-ERM), a multimodal generative reward model that provides fine-grained, interpretable, and task-agnostic feedback to evaluate vision-to-code quality directly in the rendered visual space. Integrated into RL, Visual-ERM improves Qwen3-VL-8B-Instruct by +8.4 on chart-to-code and yields consistent gains on table and SVG parsing (+2.7, +4.1 on average), and further strengthens test-time scaling via reflection and revision. We also introduce VisualCritic-RewardBench (VC-RewardBench), a benchmark for judging fine-grained image-to-image discrepancies on structured visual data, where Visual-ERM at 8B decisively outperforms Qwen3-VL-235B-Instruct and approaches leading closed-source models. Our results suggest that fine-grained visual reward supervision is both necessary and sufficient for vision-to-code RL, regardless of task specificity.
69b76e7a91a28162b233fc06
Ziyu Liu
69b76e7a91a28162b233fc07
Shengyuan Ding
admin_assigned
2026-03-16T10:57:58.698Z
646cd947da8e99940b6e55cf
https://cdn-avatars.huggingface.co/v1/production/uploads/646cd947da8e99940b6e55cf/9c0P0WppFqNW9pdo8LgOS.jpeg
Shengyuan Ding
ChrisDing1105
user
ChrisDing1105
69b76e7a91a28162b233fc08
Xinyu Fang
69b76e7a91a28162b233fc09
Xuanlang Dai
69b76e7a91a28162b233fc0a
Penghui Yang
admin_assigned
2026-03-16T10:58:20.214Z
6508463c423b46492eec64e2
https://cdn-avatars.huggingface.co/v1/production/uploads/6508463c423b46492eec64e2/WSU7NSqjk92Pr2xUIWjCk.png
Penghui Yang
phyang
user
phyang
69b76e7a91a28162b233fc0b
Jianze Liang
admin_assigned
2026-03-16T10:58:26.301Z
64fdec45c45dd732acecd4db
/avatars/88fc9a7fb8029572e24868e0c02fa5f0.svg
Jianze Liang
ohlionel
user
ohlionel
69b76e7a91a28162b233fc0c
Jiaqi Wang
69b76e7a91a28162b233fc0d
Kai Chen
69b76e7a91a28162b233fc0e
Dahua Lin
admin_assigned
2026-03-16T10:58:36.931Z
636317ed80c1a705a6eff396
/avatars/3db090e101b916d9256d0d3e043db71d.svg
Dahua Lin
lindahua
user
lindahua
69b76e7a91a28162b233fc0f
Yuhang Zang
claimed_verified
2026-03-16T10:40:12.344Z
63859cf3b2906edaf83af9f0
https://cdn-avatars.huggingface.co/v1/production/uploads/63859cf3b2906edaf83af9f0/kajwuVzd4pDucSPlwghxo.png
Yuhang Zang
yuhangzang
user
yuhangzang
Visual-ERM: Reward Modeling for Visual Equivalence
Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs) achieve strong results via supervised fine-tuning, reinforcement learning remains challenging due to misaligned reward signals. Existing rewards either rely on textual rules or coarse visual embedding similarity, both of which fail to capture fine-grained visual discrepancies and are vulnerable to reward hacking. We propose Visual Equivalence Reward Model (Visual-ERM), a multimodal generative reward model that provides fine-grained, interpretable, and task-agnostic feedback to evaluate vision-to-code quality directly in the rendered visual space. Integrated into RL, Visual-ERM improves Qwen3-VL-8B-Instruct by +8.4 on chart-to-code and yields consistent gains on table and SVG parsing (+2.7, +4.1 on average), and further strengthens test-time scaling via reflection and revision. We also introduce VisualCritic-RewardBench (VC-RewardBench), a benchmark for judging fine-grained image-to-image discrepancies on structured visual data, where Visual-ERM at 8B decisively outperforms Qwen3-VL-235B-Instruct and approaches leading closed-source models. Our results suggest that fine-grained visual reward supervision is both necessary and sufficient for vision-to-code RL, regardless of task specificity.
Visual-ERM, a multimodal generative reward model, provides fine-grained visual feedback for vision-to-code tasks, improving reinforcement learning performance and establishing a new benchmark for structured visual evaluation.
Large Vision Language Models reinforcement learning reward signals visual equivalence reward model multimodal generative reward model vision-to-code visual fidelity reward hacking Qwen3-VL VisualCritic-RewardBench