Scaling Spatial Intelligence with Multimodal Foundation Models
Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence within the SenseNova-SI family, built upon established multimodal foundations including visual understanding models (i.e., Qwen3-VL and InternVL3) and unified understanding and generation models (i.e., Bagel). We take a principled approach to constructing high-performing and robust spatial intelligence by systematically curating SenseNova-SI-8M: eight million diverse data samples under a rigorous taxonomy of spatial capabilities. SenseNova-SI demonstrates unprecedented performance across a broad range of spatial intelligence benchmarks: 68.7% on VSI-Bench, 43.3% on MMSI, 85.6% on MindCube, 54.6% on ViewSpatial, and 50.1% on SITE, while maintaining strong general multimodal understanding (e.g., 84.9% on MMBench-En). More importantly, we analyze the impact of data scaling, discuss early signs of emergent generalization capabilities enabled by diverse data training, analyze the risk of overfitting and language shortcuts, present a preliminary study on spatial chain-of-thought reasoning, and validate the potential downstream application. SenseNova-SI is an ongoing project, and this report will be updated continuously. All newly trained multimodal foundation models are publicly released to facilitate further research in this direction.
691f541c6d58f71c91487f52
Zhongang Cai
claimed_verified
2025-11-21T09:00:34.042Z
652d06833b5997ed71ce5c46
https://cdn-avatars.huggingface.co/v1/production/uploads/652d06833b5997ed71ce5c46/O_D6bpa5mGxLA7uCjmVCG.jpeg
Zhongang Cai
caizhongang
user
caizhongang
691f541c6d58f71c91487f53
Ruisi Wang
claimed_verified
2026-02-24T09:52:12.911Z
65b74305e602b6c2c9125480
https://cdn-avatars.huggingface.co/v1/production/uploads/65b74305e602b6c2c9125480/mooL0oaSJX4b3aVGH7JZr.jpeg
wang ruisi
wruisi
user
wruisi
691f541c6d58f71c91487f54
Chenyang Gu
claimed_verified
2026-03-23T11:03:16.298Z
690429d49d820cebdc618411
/avatars/74504e5c8de5be64d4791143ff46bef5.svg
Gu Chenyang
rheallyc
user
rheallyc
691f541c6d58f71c91487f55
Fanyi Pu
claimed_verified
2025-11-21T09:00:39.316Z
646e1ef5075bbcc48ddf21e8
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/_vJC0zeVOIvaNV2R6toqg.jpeg
Pu Fanyi
pufanyi
user
pufanyi
691f541c6d58f71c91487f56
Junxiang Xu
claimed_verified
2026-03-23T11:03:14.466Z
680b0d0f1173808fedf31f96
/avatars/ec920acf1200fc301737529aaabc87db.svg
Junxiang Xu
junxiangjoe
user
junxiangjoe
691f541c6d58f71c91487f57
Yubo Wang
691f541c6d58f71c91487f58
Wanqi Yin
claimed_verified
2026-03-23T11:03:12.528Z
668f51fb8e8d87dbdd23caa9
/avatars/0b17cb0f3ad2c729f185cdccdad94e48.svg
Yin Wanqi
waanqii
user
waanqii
691f541c6d58f71c91487f59
Zhitao Yang
691f541c6d58f71c91487f5a
Chen Wei
691f541c6d58f71c91487f5b
Qingping Sun
691f541c6d58f71c91487f5c
Tongxi Zhou
691f541c6d58f71c91487f5d
Jiaqi Li
691f541c6d58f71c91487f5e
Hui En Pang
691f541c6d58f71c91487f5f
Oscar Qian
claimed_verified
2025-11-21T09:00:37.084Z
647ae5462d27d3541deb70ff
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/BK7z2jhmKq3asDuiGmT3L.png
Oscar J Qian
oscarqjh
user
oscarqjh
691f541c6d58f71c91487f60
Yukun Wei
691f541c6d58f71c91487f61
Zhiqian Lin
691f541c6d58f71c91487f62
Xuanke Shi
claimed_verified
2025-11-24T12:27:07.478Z
634f8986d049354d7ee93db2
https://cdn-avatars.huggingface.co/v1/production/uploads/634f8986d049354d7ee93db2/CKYqG-m2q0Jf2_TpNJwwd.jpeg
Xuanke Shi
shixuanke
user
shixuanke
691f541c6d58f71c91487f63
Kewang Deng
691f541c6d58f71c91487f64
Xiaoyang Han
claimed_verified
2025-11-21T09:00:30.589Z
65d201b32383296176d7cc6b
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/mdYa9UxX8yAogrtHA3olj.jpeg
Xiaoyang Han
robinhanxy
user
robinhanxy
691f541c6d58f71c91487f65
Zukai Chen
691f541c6d58f71c91487f66
Xiangyu Fan
691f541c6d58f71c91487f67
Hanming Deng
691f541c6d58f71c91487f68
Lewei Lu
691f541c6d58f71c91487f69
Liang Pan
691f541c6d58f71c91487f6a
Bo Li
691f541c6d58f71c91487f6b
Ziwei Liu
691f541c6d58f71c91487f6c
Quan Wang
691f541c6d58f71c91487f6d
Dahua Lin
691f541c6d58f71c91487f6e
Lei Yang
claimed_verified
2025-11-21T09:00:32.441Z
6626a471430a124253f197c8
https://cdn-avatars.huggingface.co/v1/production/uploads/6626a471430a124253f197c8/uVEk5nnW-bS6-no0rQ7Wh.png
yl-1993
yl-1993
user
yl-1993
Scaling Spatial Intelligence with Multimodal Foundation Models
Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence within the SenseNova-SI family, built upon established multimodal foundations including visual understanding models (i.e., Qwen3-VL and InternVL3) and unified understanding and generation models (i.e., Bagel). We take a principled approach to constructing high-performing and robust spatial intelligence by systematically curating SenseNova-SI-8M: eight million diverse data samples under a rigorous taxonomy of spatial capabilities. SenseNova-SI demonstrates unprecedented performance across a broad range of spatial intelligence benchmarks: 68.7% on VSI-Bench, 43.3% on MMSI, 85.6% on MindCube, 54.6% on ViewSpatial, and 50.1% on SITE, while maintaining strong general multimodal understanding (e.g., 84.9% on MMBench-En). More importantly, we analyze the impact of data scaling, discuss early signs of emergent generalization capabilities enabled by diverse data training, analyze the risk of overfitting and language shortcuts, present a preliminary study on spatial chain-of-thought reasoning, and validate the potential downstream application. SenseNova-SI is an ongoing project, and this report will be updated continuously. All newly trained multimodal foundation models are publicly released to facilitate further research in this direction.
Multimodal foundation models like SenseNova-SI improve spatial intelligence through diverse data scaling and demonstrate strong performance across various spatial benchmarks while maintaining general multimodal understanding.
multimodal foundation models spatial intelligence SenseNova-SI SenseNova-SI-8M visual understanding models unified understanding and generation models spatial capabilities VSI-Bench MMSI MindCube ViewSpatial SITE MMBench-En spatial chain-of-thought reasoning