MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods
Recent advances in Vision Language Models (VLMs) have driven significant progress in visual reasoning. However, open-source VLMs still lag behind proprietary systems, largely due to the lack of high-quality reasoning data. Existing datasets offer limited coverage of challenging domains such as STEM diagrams and visual puzzles, and lack consistent, long-form Chain-of-Thought (CoT) annotations essential for eliciting strong reasoning capabilities. To bridge this gap, we introduce MMFineReason, a large-scale multimodal reasoning dataset comprising 1.8M samples and 5.1B solution tokens, featuring high-quality reasoning annotations distilled from Qwen3-VL-235B-A22B-Thinking. The dataset is established via a systematic three-stage pipeline: (1) large-scale data collection and standardization, (2) CoT rationale generation, and (3) comprehensive selection based on reasoning quality and difficulty awareness. The resulting dataset spans STEM problems, visual puzzles, games, and complex diagrams, with each sample annotated with visually grounded reasoning traces. We fine-tune Qwen3-VL-Instruct on MMFineReason to develop MMFineReason-2B/4B/8B versions. Our models establish new state-of-the-art results for their size class. Notably, MMFineReason-4B succesfully surpasses Qwen3-VL-8B-Thinking, and MMFineReason-8B even outperforms Qwen3-VL-30B-A3B-Thinking while approaching Qwen3-VL-32B-Thinking, demonstrating remarkable parameter efficiency. Crucially, we uncover a "less is more" phenomenon via our difficulty-aware filtering strategy: a subset of just 7\% (123K samples) achieves performance comparable to the full dataset. Notably, we reveal a synergistic effect where reasoning-oriented data composition simultaneously boosts general capabilities.
697c2a0ca67238fac88cc11e
Honglin Lin
claimed_verified
2026-02-04T19:04:12.119Z
640d99628512ec51d7ef71c7
https://cdn-avatars.huggingface.co/v1/production/uploads/640d99628512ec51d7ef71c7/fcBkqnxfxuuuZTqfN_BGy.jpeg
Honglin Lin
LHL3341
user
LHL3341
697c2a0ca67238fac88cc11f
Zheng Liu
claimed_verified
2026-01-30T09:36:23.860Z
6625ef13605f46d05c1d0031
/avatars/22f201dca35e43013cb593884516e96c.svg
Zheng Liu
starriver030515
user
starriver030515
697c2a0ca67238fac88cc120
Yun Zhu
697c2a0ca67238fac88cc121
Chonghan Qin
claimed_verified
2026-01-30T09:36:20.559Z
67b30bb2c2e25cfcdeda4a2f
https://cdn-avatars.huggingface.co/v1/production/uploads/67b30bb2c2e25cfcdeda4a2f/K5ePD5uWNkwlpkI_43Oe1.jpeg
Chonghan, Qin
J017athan
user
J017athan
697c2a0ca67238fac88cc122
Juekai Lin
claimed_verified
2026-02-02T16:59:55.867Z
67fe5ff8957e1683eb54d05a
/avatars/fce87a8b6f84b48c6bc83e134fa9c131.svg
JueJue
JackieLin0123
user
JackieLin0123
697c2a0ca67238fac88cc123
Xiaoran Shang
claimed_verified
2026-02-03T10:08:53.045Z
673236a91773c42566fdd950
https://cdn-avatars.huggingface.co/v1/production/uploads/673236a91773c42566fdd950/G4fqo-sLuf0_sADkOSw3S.jpeg
XiaoranShang
xrose
user
xrose
697c2a0ca67238fac88cc124
Conghui He
697c2a0ca67238fac88cc125
Wentao Zhang
697c2a0ca67238fac88cc126
Lijun Wu
claimed_verified
2026-02-02T16:59:57.898Z
643e60d96db6ba8c5ee177ad
/avatars/73ac7740e462ba0b53a2f2480d9f1e3e.svg
Lijun Wu
apeters
user
apeters
MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods
Recent advances in Vision Language Models (VLMs) have driven significant progress in visual reasoning. However, open-source VLMs still lag behind proprietary systems, largely due to the lack of high-quality reasoning data. Existing datasets offer limited coverage of challenging domains such as STEM diagrams and visual puzzles, and lack consistent, long-form Chain-of-Thought (CoT) annotations essential for eliciting strong reasoning capabilities. To bridge this gap, we introduce MMFineReason, a large-scale multimodal reasoning dataset comprising 1.8M samples and 5.1B solution tokens, featuring high-quality reasoning annotations distilled from Qwen3-VL-235B-A22B-Thinking. The dataset is established via a systematic three-stage pipeline: (1) large-scale data collection and standardization, (2) CoT rationale generation, and (3) comprehensive selection based on reasoning quality and difficulty awareness. The resulting dataset spans STEM problems, visual puzzles, games, and complex diagrams, with each sample annotated with visually grounded reasoning traces. We fine-tune Qwen3-VL-Instruct on MMFineReason to develop MMFineReason-2B/4B/8B versions. Our models establish new state-of-the-art results for their size class. Notably, MMFineReason-4B succesfully surpasses Qwen3-VL-8B-Thinking, and MMFineReason-8B even outperforms Qwen3-VL-30B-A3B-Thinking while approaching Qwen3-VL-32B-Thinking, demonstrating remarkable parameter efficiency. Crucially, we uncover a "less is more" phenomenon via our difficulty-aware filtering strategy: a subset of just 7\% (123K samples) achieves performance comparable to the full dataset. Notably, we reveal a synergistic effect where reasoning-oriented data composition simultaneously boosts general capabilities.
A large-scale multimodal reasoning dataset called MMFineReason is introduced to improve vision language models' performance through high-quality reasoning annotations and demonstrates superior parameter efficiency in fine-tuned models.
Vision Language Models Chain-of-Thought multimodal reasoning Qwen3-VL CoT rationale generation reasoning quality difficulty awareness parameter efficiency general capabilities