Part-X-MLLM: Part-aware 3D Multimodal Large Language Model
We introduce Part-X-MLLM, a native 3D multimodal large language model that unifies diverse 3D tasks by formulating them as programs in a structured, executable grammar. Given an RGB point cloud and a natural language prompt, our model autoregressively generates a single, coherent token sequence encoding part-level bounding boxes, semantic descriptions, and edit commands. This structured output serves as a versatile interface to drive downstream geometry-aware modules for part-based generation and editing. By decoupling the symbolic planning from the geometric synthesis, our approach allows any compatible geometry engine to be controlled through a single, language-native frontend. We pre-train a dual-encoder architecture to disentangle structure from semantics and instruction-tune the model on a large-scale, part-centric dataset. Experiments demonstrate that our model excels at producing high-quality, structured plans, enabling state-of-the-art performance in grounded Q\&A, compositional generation, and localized editing through one unified interface. Project page: https://chunshi.wang/Part-X-MLLM/
691bf0036bfd5965c0fd38e6
Chunshi Wang
claimed_verified
2025-11-18T14:07:33.977Z
686fc1fb779dd387eb29a46b
https://cdn-avatars.huggingface.co/v1/production/uploads/686fc1fb779dd387eb29a46b/jdBko2vuxOB9HGAoryMZS.jpeg
Chunshi Wang
AiEson2
user
AiEson2
691bf0036bfd5965c0fd38e7
Junliang Ye
claimed_verified
2025-11-18T14:07:38.454Z
65a420cd90e65dc39a6abe9e
/avatars/81ac5b749043e899f5017782409f9e28.svg
yejunliang
yejunliang23
user
yejunliang23
691bf0036bfd5965c0fd38e8
Yunhan Yang
claimed_verified
2026-03-10T09:47:02.392Z
64b4eecf2fc8324fcb63b404
https://cdn-avatars.huggingface.co/v1/production/uploads/64b4eecf2fc8324fcb63b404/zGYqYVB4-o-GBMybJ8CDA.png
Yunhan Yang
yhyang-myron
user
yhyang-myron
691bf0036bfd5965c0fd38e9
Yang Li
691bf0036bfd5965c0fd38ea
Zizhuo Lin
691bf0036bfd5965c0fd38eb
Jun Zhu
691bf0036bfd5965c0fd38ec
Zhuo Chen
691bf0036bfd5965c0fd38ed
Yawei Luo
691bf0036bfd5965c0fd38ee
Chunchao Guo
Part-X-MLLM: Part-aware 3D Multimodal Large Language Model
We introduce Part-X-MLLM, a native 3D multimodal large language model that unifies diverse 3D tasks by formulating them as programs in a structured, executable grammar. Given an RGB point cloud and a natural language prompt, our model autoregressively generates a single, coherent token sequence encoding part-level bounding boxes, semantic descriptions, and edit commands. This structured output serves as a versatile interface to drive downstream geometry-aware modules for part-based generation and editing. By decoupling the symbolic planning from the geometric synthesis, our approach allows any compatible geometry engine to be controlled through a single, language-native frontend. We pre-train a dual-encoder architecture to disentangle structure from semantics and instruction-tune the model on a large-scale, part-centric dataset. Experiments demonstrate that our model excels at producing high-quality, structured plans, enabling state-of-the-art performance in grounded Q\&A, compositional generation, and localized editing through one unified interface. Project page: https://chunshi.wang/Part-X-MLLM/