AvatarPointillist: AutoRegressive 4D Gaussian Avatarization
We introduce AvatarPointillist, a novel framework for generating dynamic 4D Gaussian avatars from a single portrait image. At the core of our method is a decoder-only Transformer that autoregressively generates a point cloud for 3D Gaussian Splatting. This sequential approach allows for precise, adaptive construction, dynamically adjusting point density and the total number of points based on the subject's complexity. During point generation, the AR model also jointly predicts per-point binding information, enabling realistic animation. After generation, a dedicated Gaussian decoder converts the points into complete, renderable Gaussian attributes. We demonstrate that conditioning the decoder on the latent features from the AR generator enables effective interaction between stages and markedly improves fidelity. Extensive experiments validate that AvatarPointillist produces high-quality, photorealistic, and controllable avatars. We believe this autoregressive formulation represents a new paradigm for avatar generation, and we will release our code inspire future research.
69d4a1762c523d36431fb2db
Hongyu Liu
69d4a1762c523d36431fb2dc
Xuan Wang
69d4a1762c523d36431fb2dd
Yating Wang
69d4a1762c523d36431fb2de
Zijian Wu
69d4a1762c523d36431fb2df
Ziyu Wan
69d4a1762c523d36431fb2e0
Yue Ma
69d4a1762c523d36431fb2e1
Runtao Liu
69d4a1762c523d36431fb2e2
Boyao Zhou
69d4a1762c523d36431fb2e3
Yujun Shen
69d4a1762c523d36431fb2e4
Qifeng Chen
AvatarPointillist: AutoRegressive 4D Gaussian Avatarization
We introduce AvatarPointillist, a novel framework for generating dynamic 4D Gaussian avatars from a single portrait image. At the core of our method is a decoder-only Transformer that autoregressively generates a point cloud for 3D Gaussian Splatting. This sequential approach allows for precise, adaptive construction, dynamically adjusting point density and the total number of points based on the subject's complexity. During point generation, the AR model also jointly predicts per-point binding information, enabling realistic animation. After generation, a dedicated Gaussian decoder converts the points into complete, renderable Gaussian attributes. We demonstrate that conditioning the decoder on the latent features from the AR generator enables effective interaction between stages and markedly improves fidelity. Extensive experiments validate that AvatarPointillist produces high-quality, photorealistic, and controllable avatars. We believe this autoregressive formulation represents a new paradigm for avatar generation, and we will release our code inspire future research.
AvatarPointillist generates dynamic 4D Gaussian avatars using a decoder-only Transformer that autoregressively constructs point clouds with adaptive density and binding information for realistic animation.
decoder-only Transformer autoregressive generation point cloud 3D Gaussian Splatting point density binding information Gaussian decoder latent features avatar generation