From Spatial to Actions: Grounding Vision-Language-Action Model in
  Spatial Foundation Priors
Existing vision-language-action (VLA) models act in 3D real-world but are
typically built on 2D encoders, leaving a spatial reasoning gap that limits
generalization and adaptability. Recent 3D integration techniques for VLAs
either require specialized sensors and transfer poorly across modalities, or
inject weak cues that lack geometry and degrade vision-language alignment. In
this work, we introduce FALCON (From Spatial to Action), a novel paradigm that
injects rich 3D spatial tokens into the action head. FALCON leverages spatial
foundation models to deliver strong geometric priors from RGB alone, and
includes an Embodied Spatial Model that can optionally fuse depth, or pose for
higher fidelity when available, without retraining or architectural changes. To
preserve language reasoning, spatial tokens are consumed by a Spatial-Enhanced
Action Head rather than being concatenated into the vision-language backbone.
These designs enable FALCON to address limitations in spatial representation,
modality transferability, and alignment. In comprehensive evaluations across
three simulation benchmarks and eleven real-world tasks, our proposed FALCON
achieves state-of-the-art performance, consistently surpasses competitive
baselines, and remains robust under clutter, spatial-prompt conditioning, and
variations in object scale and height.
6901c2c1646208eac0d1f577
Zhengshen Zhang
claimed_verified
2025-10-29T12:40:44.683Z
68c14544a9a07d79e3e13166
/avatars/3c3f15bccb59d0a56c866b5c100cb35e.svg
Zhengshen Zhang
flameeee
user
flameeee
6901c2c1646208eac0d1f578
Hao Li
claimed_verified
2025-10-29T12:40:47.831Z
667b8de7a68bf81afe668afe
/avatars/aeff10805ff858332e6f6a58735dbbd9.svg
leoli
lifuguan
user
lifuguan
6901c2c1646208eac0d1f579
Yalun Dai
6901c2c1646208eac0d1f57a
Zhengbang Zhu
6901c2c1646208eac0d1f57b
Lei Zhou
claimed_verified
2025-10-30T14:41:33.588Z
66e00b969847e63c5c1a92e4
/avatars/9aa0adef21cfb98bdcc2d0c03a3687e6.svg
Lei
Zray26
user
Zray26
6901c2c1646208eac0d1f57c
Chenchen Liu
6901c2c1646208eac0d1f57d
Dong Wang
6901c2c1646208eac0d1f57e
Francis E. H. Tay
6901c2c1646208eac0d1f57f
Sijin Chen
claimed_verified
2025-10-30T14:41:35.820Z
6485b08e687d9e0c759121b0
https://cdn-avatars.huggingface.co/v1/production/uploads/6485b08e687d9e0c759121b0/P_9F0izrQgUfEd-VEbhg8.jpeg
sijin
CH3COOK
user
CH3COOK
6901c2c1646208eac0d1f580
Ziwei Liu
6901c2c1646208eac0d1f581
Yuxiao Liu
claimed_verified
2025-11-03T20:57:45.963Z
6772383bb19143bfea926c92
/avatars/4dbaaa791a731543381455821924a265.svg
Yuxiao Liu
TopoInside
user
TopoInside
6901c2c1646208eac0d1f582
Xinghang Li
6901c2c1646208eac0d1f583
Pan Zhou
From Spatial to Actions: Grounding Vision-Language-Action Model in
  Spatial Foundation Priors
Existing vision-language-action (VLA) models act in 3D real-world but are
typically built on 2D encoders, leaving a spatial reasoning gap that limits
generalization and adaptability. Recent 3D integration techniques for VLAs
either require specialized sensors and transfer poorly across modalities, or
inject weak cues that lack geometry and degrade vision-language alignment. In
this work, we introduce FALCON (From Spatial to Action), a novel paradigm that
injects rich 3D spatial tokens into the action head. FALCON leverages spatial
foundation models to deliver strong geometric priors from RGB alone, and
includes an Embodied Spatial Model that can optionally fuse depth, or pose for
higher fidelity when available, without retraining or architectural changes. To
preserve language reasoning, spatial tokens are consumed by a Spatial-Enhanced
Action Head rather than being concatenated into the vision-language backbone.
These designs enable FALCON to address limitations in spatial representation,
modality transferability, and alignment. In comprehensive evaluations across
three simulation benchmarks and eleven real-world tasks, our proposed FALCON
achieves state-of-the-art performance, consistently surpasses competitive
baselines, and remains robust under clutter, spatial-prompt conditioning, and
variations in object scale and height.
FALCON enhances vision-language-action models by integrating rich 3D spatial tokens into the action head, improving spatial reasoning and modality transferability.
vision-language-action (VLA) models 3D integration spatial tokens spatial foundation models Embodied Spatial Model Spatial-Enhanced Action Head spatial representation modality transferability vision-language alignment