Think3D: Thinking with Space for Spatial Reasoning
Understanding and reasoning about the physical world requires spatial intelligence: the ability to interpret geometry, perspective, and spatial relations beyond 2D perception. While recent vision large models (VLMs) excel at visual understanding, they remain fundamentally 2D perceivers and struggle with genuine 3D reasoning. We introduce Think3D, a framework that enables VLM agents to think with 3D space. By leveraging 3D reconstruction models that recover point clouds and camera poses from images or videos, Think3D allows the agent to actively manipulate space through camera-based operations and ego/global-view switching, transforming spatial reasoning into an interactive 3D chain-of-thought process. Without additional training, Think3D significantly improves the spatial reasoning performance of advanced models such as GPT-4.1 and Gemini 2.5 Pro, yielding average gains of +7.8% on BLINK Multi-view and MindCube, and +4.7% on VSI-Bench. We further show that smaller models, which struggle with spatial exploration, benefit significantly from a reinforcement learning policy that enables the model to select informative viewpoints and operations. With RL, the benefit from tool usage increases from +0.7% to +6.8%. Our findings demonstrate that training-free, tool-augmented spatial exploration is a viable path toward more flexible and human-like 3D reasoning in multimodal agents, establishing a new dimension of multimodal intelligence. Code and weights are released at https://github.com/zhangzaibin/spagent.
69708ffea8be625b19c2b04c
Zaibin Zhang
admin_assigned
2026-01-21T11:47:45.167Z
6575702b15b1ca184b0b2700
https://cdn-avatars.huggingface.co/v1/production/uploads/6575702b15b1ca184b0b2700/O9cEodqQmG-gyqMiO_edR.jpeg
Zaibin Zhang
MrBean2024
user
MrBean2024
69708ffea8be625b19c2b04d
Yuhan Wu
69708ffea8be625b19c2b04e
Lianjie Jia
69708ffea8be625b19c2b04f
Yifan Wang
69708ffea8be625b19c2b050
Zhongbo Zhang
69708ffea8be625b19c2b051
Yijiang Li
claimed_verified
2026-02-11T11:20:29.558Z
6419309f22270b3ccf177c77
https://cdn-avatars.huggingface.co/v1/production/uploads/6419309f22270b3ccf177c77/KQa1586iBBKqucUlfpuPp.jpeg
William Li
williamium
user
williamium
69708ffea8be625b19c2b052
Binghao Ran
69708ffea8be625b19c2b053
Fuxi Zhang
69708ffea8be625b19c2b054
Zhuohan Sun
admin_assigned
2026-01-21T11:59:29.495Z
68ad6a9106bcf0ebe9624dc5
/avatars/309e383889f848c828d4b1eb4542b54a.svg
SunZhuohan
sunz525
user
sunz525
69708ffea8be625b19c2b055
Zhenfei Yin
admin_assigned
2026-01-21T11:59:18.401Z
64e314ad24809d7fa0f20fbc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/bHE0w_hjDFvU-Aul0_E7g.jpeg
Zhenfei Yin
JeremyYin
user
JeremyYin
69708ffea8be625b19c2b056
Lijun Wang
69708ffea8be625b19c2b057
Huchuan Lu
Think3D: Thinking with Space for Spatial Reasoning
Understanding and reasoning about the physical world requires spatial intelligence: the ability to interpret geometry, perspective, and spatial relations beyond 2D perception. While recent vision large models (VLMs) excel at visual understanding, they remain fundamentally 2D perceivers and struggle with genuine 3D reasoning. We introduce Think3D, a framework that enables VLM agents to think with 3D space. By leveraging 3D reconstruction models that recover point clouds and camera poses from images or videos, Think3D allows the agent to actively manipulate space through camera-based operations and ego/global-view switching, transforming spatial reasoning into an interactive 3D chain-of-thought process. Without additional training, Think3D significantly improves the spatial reasoning performance of advanced models such as GPT-4.1 and Gemini 2.5 Pro, yielding average gains of +7.8% on BLINK Multi-view and MindCube, and +4.7% on VSI-Bench. We further show that smaller models, which struggle with spatial exploration, benefit significantly from a reinforcement learning policy that enables the model to select informative viewpoints and operations. With RL, the benefit from tool usage increases from +0.7% to +6.8%. Our findings demonstrate that training-free, tool-augmented spatial exploration is a viable path toward more flexible and human-like 3D reasoning in multimodal agents, establishing a new dimension of multimodal intelligence. Code and weights are released at https://github.com/zhangzaibin/spagent.
Think3D enhances vision-language models' 3D reasoning capabilities by enabling interactive spatial exploration through 3D reconstruction and camera-based operations, improving performance without additional training.
vision large models 3D reconstruction models point clouds camera poses spatial reasoning 3D chain-of-thought process reinforcement learning policy multimodal agents 3D reasoning