iFSQ: Improving FSQ for Image Generation with 1 Line of Code
The field of image generation is currently bifurcated into autoregressive (AR) models operating on discrete tokens and diffusion models utilizing continuous latents. This divide, rooted in the distinction between VQ-VAEs and VAEs, hinders unified modeling and fair benchmarking. Finite Scalar Quantization (FSQ) offers a theoretical bridge, yet vanilla FSQ suffers from a critical flaw: its equal-interval quantization can cause activation collapse. This mismatch forces a trade-off between reconstruction fidelity and information efficiency. In this work, we resolve this dilemma by simply replacing the activation function in original FSQ with a distribution-matching mapping to enforce a uniform prior. Termed iFSQ, this simple strategy requires just one line of code yet mathematically guarantees both optimal bin utilization and reconstruction precision. Leveraging iFSQ as a controlled benchmark, we uncover two key insights: (1) The optimal equilibrium between discrete and continuous representations lies at approximately 4 bits per dimension. (2) Under identical reconstruction constraints, AR models exhibit rapid initial convergence, whereas diffusion models achieve a superior performance ceiling, suggesting that strict sequential ordering may limit the upper bounds of generation quality. Finally, we extend our analysis by adapting Representation Alignment (REPA) to AR models, yielding LlamaGen-REPA. Codes is available at https://github.com/Tencent-Hunyuan/iFSQ
6978407f026bdf0473116f26
Bin Lin
6978407f026bdf0473116f27
Zongjian Li
claimed_verified
2026-01-27T14:27:26.565Z
646df3c04ad7f907279f14c3
https://cdn-avatars.huggingface.co/v1/production/uploads/646df3c04ad7f907279f14c3/WZjSDtAmezmjbczLtCP2B.jpeg
Zongjian Li
chestnutlzj
user
chestnutlzj
6978407f026bdf0473116f28
Yuwei Niu
admin_assigned
2026-01-27T14:28:08.456Z
66915a572c1a3a8edcc977b4
https://cdn-avatars.huggingface.co/v1/production/uploads/66915a572c1a3a8edcc977b4/2tANTgj48VQMgCcEcdkwE.jpeg
Yuwei Niu
Yuwei-Niu
user
Yuwei-Niu
6978407f026bdf0473116f29
Kaixiong Gong
admin_assigned
2026-01-27T14:28:14.260Z
642e427f6748dd4f8eeb2f38
/avatars/07158ff6aa1803c846403594c5d55a34.svg
Kaixiong Gong
kxgong
user
kxgong
6978407f026bdf0473116f2a
Yunyang Ge
admin_assigned
2026-01-27T14:28:20.323Z
646de6402fd5a8eb8c518aa6
https://cdn-avatars.huggingface.co/v1/production/uploads/646de6402fd5a8eb8c518aa6/HYWb8-fT1kTm-ROBr1-0X.jpeg
yunyangge
yunyangge
user
yunyangge
6978407f026bdf0473116f2b
Yunlong Lin
6978407f026bdf0473116f2c
Mingzhe Zheng
admin_assigned
2026-01-27T14:28:29.309Z
62f0c4abe2999b231e5a893c
/avatars/90da268b877a7ffe6665075c84018a83.svg
Mingzhe Zheng
Dunge0nMaster
user
Dunge0nMaster
6978407f026bdf0473116f2d
JianWei Zhang
6978407f026bdf0473116f2e
Miles Yang
admin_assigned
2026-01-27T14:28:41.196Z
680d79e978e732e7141e9280
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/YzX3HGEEHCXDcFymaiREA.png
Miles Yang
dovahkiin648
user
dovahkiin648
6978407f026bdf0473116f2f
Zhao Zhong
6978407f026bdf0473116f30
Liefeng Bo
admin_assigned
2026-01-27T14:28:53.581Z
63d0cc736b985b0f25d0412c
/avatars/3eb8c79f9a7c4c819038ea7b04e323dd.svg
Bo
Liefeng
user
Liefeng
6978407f026bdf0473116f31
Li Yuan
iFSQ: Improving FSQ for Image Generation with 1 Line of Code
The field of image generation is currently bifurcated into autoregressive (AR) models operating on discrete tokens and diffusion models utilizing continuous latents. This divide, rooted in the distinction between VQ-VAEs and VAEs, hinders unified modeling and fair benchmarking. Finite Scalar Quantization (FSQ) offers a theoretical bridge, yet vanilla FSQ suffers from a critical flaw: its equal-interval quantization can cause activation collapse. This mismatch forces a trade-off between reconstruction fidelity and information efficiency. In this work, we resolve this dilemma by simply replacing the activation function in original FSQ with a distribution-matching mapping to enforce a uniform prior. Termed iFSQ, this simple strategy requires just one line of code yet mathematically guarantees both optimal bin utilization and reconstruction precision. Leveraging iFSQ as a controlled benchmark, we uncover two key insights: (1) The optimal equilibrium between discrete and continuous representations lies at approximately 4 bits per dimension. (2) Under identical reconstruction constraints, AR models exhibit rapid initial convergence, whereas diffusion models achieve a superior performance ceiling, suggesting that strict sequential ordering may limit the upper bounds of generation quality. Finally, we extend our analysis by adapting Representation Alignment (REPA) to AR models, yielding LlamaGen-REPA. Codes is available at https://github.com/Tencent-Hunyuan/iFSQ
Finite Scalar Quantization with improved activation mapping enables unified modeling of discrete and continuous image generation approaches, revealing optimal representation balance and performance characteristics.
autoregressive models diffusion models VQ-VAEs VAEs finite scalar quantization activation collapse distribution-matching mapping iFSQ representation alignment LlamaGen-REPA