HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning
VLMs show strong multimodal capabilities, but they still struggle with fine-grained vision-language reasoning. We find that long CoT reasoning exposes diverse failure modes, including perception, reasoning, knowledge, and hallucination errors, which can compound across intermediate steps. However, most existing vision-language data used for RLVR does not involve complex reasoning chains that rely on visual evidence throughout, leaving these weaknesses largely unexposed. We therefore propose HopChain, a scalable framework for synthesizing multi-hop vision-language reasoning data specifically for RLVR training of VLMs. Each synthesized multi-hop query forms a logically dependent chain of instance-grounded hops, where earlier hops establish the instances, sets, or conditions needed for later hops, while the final answer remains a specific, unambiguous number suitable for verifiable rewards. We add the multi-hop data synthesized by HopChain to the original RLVR data used to train Qwen3.5-35B-A3B and Qwen3.5-397B-A17B, and compare against RLVR on the original RLVR data alone across 24 benchmarks spanning STEM and Puzzle, General VQA, Text Recognition and Document Understanding, and Video Understanding. Although this multi-hop data is not synthesized to target any specific benchmark, adding it improves 20 out of 24 benchmarks on both models, indicating broad and generalizable gains. To demonstrate that full chained queries are important, we replace them with half-multi-hop or single-hop variants, reducing the 24-benchmark average accuracy by 5.3 and 7.0 points, respectively. Multi-hop training also strengthens long-CoT vision-language reasoning, with gains peaking at more than 50 accuracy points in the ultra-long-CoT regime. These experiments establish HopChain as an effective, scalable framework for synthesizing multi-hop data that improves generalizable vision-language reasoning.
69bb7435ba2b62a5fb0b0cae
Shenzhi Wang
claimed_verified
2026-03-23T10:56:32.201Z
6486dde1f74857df3f1a5828
https://cdn-avatars.huggingface.co/v1/production/uploads/6486dde1f74857df3f1a5828/FgE80CpalBO5qqArdfwxA.jpeg
Shenzhi Wang
shenzhi-wang
user
shenzhi-wang
69bb7435ba2b62a5fb0b0caf
Shixuan Liu
claimed_verified
2026-03-23T10:56:27.972Z
64e72776e9fc9d0475ef5188
/avatars/d32b9d4e1da5486c3d5f9b04fa29d167.svg
Shixuan Liu
liusx
user
liusx
69bb7435ba2b62a5fb0b0cb0
Jing Zhou
69bb7435ba2b62a5fb0b0cb1
Chang Gao
69bb7435ba2b62a5fb0b0cb2
Xiong-Hui Chen
69bb7435ba2b62a5fb0b0cb3
Binghai Wang
69bb7435ba2b62a5fb0b0cb4
An Yang
69bb7435ba2b62a5fb0b0cb5
Shiji Song
69bb7435ba2b62a5fb0b0cb6
Bowen Yu
69bb7435ba2b62a5fb0b0cb7
Gao Huang
69bb7435ba2b62a5fb0b0cb8
Junyang Lin
HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning
VLMs show strong multimodal capabilities, but they still struggle with fine-grained vision-language reasoning. We find that long CoT reasoning exposes diverse failure modes, including perception, reasoning, knowledge, and hallucination errors, which can compound across intermediate steps. However, most existing vision-language data used for RLVR does not involve complex reasoning chains that rely on visual evidence throughout, leaving these weaknesses largely unexposed. We therefore propose HopChain, a scalable framework for synthesizing multi-hop vision-language reasoning data specifically for RLVR training of VLMs. Each synthesized multi-hop query forms a logically dependent chain of instance-grounded hops, where earlier hops establish the instances, sets, or conditions needed for later hops, while the final answer remains a specific, unambiguous number suitable for verifiable rewards. We add the multi-hop data synthesized by HopChain to the original RLVR data used to train Qwen3.5-35B-A3B and Qwen3.5-397B-A17B, and compare against RLVR on the original RLVR data alone across 24 benchmarks spanning STEM and Puzzle, General VQA, Text Recognition and Document Understanding, and Video Understanding. Although this multi-hop data is not synthesized to target any specific benchmark, adding it improves 20 out of 24 benchmarks on both models, indicating broad and generalizable gains. To demonstrate that full chained queries are important, we replace them with half-multi-hop or single-hop variants, reducing the 24-benchmark average accuracy by 5.3 and 7.0 points, respectively. Multi-hop training also strengthens long-CoT vision-language reasoning, with gains peaking at more than 50 accuracy points in the ultra-long-CoT regime. These experiments establish HopChain as an effective, scalable framework for synthesizing multi-hop data that improves generalizable vision-language reasoning.
HopChain is a scalable framework that generates multi-hop vision-language reasoning data to enhance VLMs' long-chain reasoning capabilities across diverse benchmarks.
vision-language models multimodal capabilities fine-grained reasoning long CoT reasoning multi-hop reasoning visual evidence verifiable rewards Qwen3.5-35B-A3B Qwen3.5-397B-A17B RLVR STEM Puzzle General VQA Text Recognition Document Understanding Video Understanding