Long Grounded Thoughts: Distilling Compositional Visual Reasoning Chains at Scale
Recent progress in multimodal reasoning has been driven largely by undisclosed datasets and proprietary data synthesis recipes, leaving open questions about how to systematically build large-scale, vision-centric reasoning datasets, particularly for tasks that go beyond visual math. In this work, we introduce a new reasoning data generation framework spanning diverse skills and levels of complexity with over 1M high-quality synthetic vision-centric questions. The dataset also includes preference data and instruction prompts supporting both offline and online RL. Our synthesis framework proceeds in two stages: (1) scale; and (2) complexity. Reasoning traces are then synthesized through a two-stage process that leverages VLMs and reasoning LLMs, producing CoT traces for VLMs that capture the richness and diverse cognitive behaviors found in frontier reasoning models. Remarkably, we show that finetuning Qwen2.5-VL-7B on our data outperforms all open-data baselines across all evaluated vision-centric benchmarks, and even surpasses strong closed-data models such as MiMo-VL-7B-RL on V* Bench, CV-Bench and MMStar-V. Perhaps most surprising, despite being entirely vision-centric, our data transfers positively to text-only reasoning (MMLU-Pro) and audio reasoning (MMAU), demonstrating its effectiveness. Similarly, despite not containing videos or embodied visual data, we observe notable gains when evaluating on a single-evidence embodied QA benchmark (NiEH). Finally, we use our data to analyze the entire VLM post-training pipeline. Our empirical analysis highlights that (i) SFT on high-quality data with non-linear reasoning traces is essential for effective online RL, (ii) staged offline RL matches online RL's performance while reducing compute demands, and (iii) careful SFT on high quality data can substantially improve out-of-domain, cross-modality transfer.
6913700aa644ba07c499c928
David Acuna
6913700aa644ba07c499c929
Chao-Han Huck Yang
claimed_verified
2026-04-16T20:23:13.208Z
629e1b71bb6419817ed7566c
https://cdn-avatars.huggingface.co/v1/production/uploads/629e1b71bb6419817ed7566c/0ZCt-11eQtRDCOk9AozOp.jpeg
Huck Yang
huckiyang
user
huckiyang
6913700aa644ba07c499c92a
Yuntian Deng
6913700aa644ba07c499c92b
Jaehun Jung
claimed_verified
2025-11-11T19:41:00.690Z
61703fa3dff0ef663e421ab5
/avatars/96172e2782e218bbbddfdf47f96c1ad4.svg
Jaehun Jung
Jaehun
user
Jaehun
6913700aa644ba07c499c92c
Ximing Lu
6913700aa644ba07c499c92d
Prithviraj Ammanabrolu
6913700aa644ba07c499c92e
Hyunwoo Kim
claimed_verified
2026-03-30T09:12:51.481Z
627a8c1793d0b645835e65f0
https://cdn-avatars.huggingface.co/v1/production/uploads/1666754635237-627a8c1793d0b645835e65f0.jpeg
Hyunwoo Kim
heanu
user
heanu
6913700aa644ba07c499c92f
Yuan-Hong Liao
6913700aa644ba07c499c930
Yejin Choi
Long Grounded Thoughts: Distilling Compositional Visual Reasoning Chains at Scale
Recent progress in multimodal reasoning has been driven largely by undisclosed datasets and proprietary data synthesis recipes, leaving open questions about how to systematically build large-scale, vision-centric reasoning datasets, particularly for tasks that go beyond visual math. In this work, we introduce a new reasoning data generation framework spanning diverse skills and levels of complexity with over 1M high-quality synthetic vision-centric questions. The dataset also includes preference data and instruction prompts supporting both offline and online RL. Our synthesis framework proceeds in two stages: (1) scale; and (2) complexity. Reasoning traces are then synthesized through a two-stage process that leverages VLMs and reasoning LLMs, producing CoT traces for VLMs that capture the richness and diverse cognitive behaviors found in frontier reasoning models. Remarkably, we show that finetuning Qwen2.5-VL-7B on our data outperforms all open-data baselines across all evaluated vision-centric benchmarks, and even surpasses strong closed-data models such as MiMo-VL-7B-RL on V* Bench, CV-Bench and MMStar-V. Perhaps most surprising, despite being entirely vision-centric, our data transfers positively to text-only reasoning (MMLU-Pro) and audio reasoning (MMAU), demonstrating its effectiveness. Similarly, despite not containing videos or embodied visual data, we observe notable gains when evaluating on a single-evidence embodied QA benchmark (NiEH). Finally, we use our data to analyze the entire VLM post-training pipeline. Our empirical analysis highlights that (i) SFT on high-quality data with non-linear reasoning traces is essential for effective online RL, (ii) staged offline RL matches online RL's performance while reducing compute demands, and (iii) careful SFT on high quality data can substantially improve out-of-domain, cross-modality transfer.
A new reasoning data generation framework creates a large-scale vision-centric dataset with over 1M synthetic questions, enhancing performance across various benchmarks and improving cross-modality transfer.
multimodal reasoning reasoning data generation framework synthetic vision-centric questions preference data instruction prompts offline RL online RL VLMs reasoning LLMs CoT traces finetuning Qwen2.5-VL-7B MiMo-VL-7B-RL V* Bench CV-Bench MMStar-V MMLU-Pro MMAU NiEH SFT staged offline RL out-of-domain cross-modality transfer