ELT: Elastic Looped Transformers for Visual Generation
We introduce Elastic Looped Transformers (ELT), a highly parameter-efficient class of visual generative models based on a recurrent transformer architecture. While conventional generative models rely on deep stacks of unique transformer layers, our approach employs iterative, weight-shared transformer blocks to drastically reduce parameter counts while maintaining high synthesis quality. To effectively train these models for image and video generation, we propose the idea of Intra-Loop Self Distillation (ILSD), where student configurations (intermediate loops) are distilled from the teacher configuration (maximum training loops) to ensure consistency across the model's depth in a single training step. Our framework yields a family of elastic models from a single training run, enabling Any-Time inference capability with dynamic trade-offs between computational cost and generation quality, with the same parameter count. ELT significantly shifts the efficiency frontier for visual synthesis. With 4times reduction in parameter count under iso-inference-compute settings, ELT achieves a competitive FID of 2.0 on class-conditional ImageNet 256 times 256 and FVD of 72.8 on class-conditional UCF-101.
69dc4bc22b6b8dc66ffeeb3c
Sahil Goyal
claimed_verified
2026-04-13T09:50:09.655Z
676e8818c84ae66f46855df3
/avatars/c6a113e8d9008a91251a0e5d74c66cd9.svg
Sahil Goyal
goyalsahil
user
goyalsahil
69dc4bc22b6b8dc66ffeeb3d
Swayam Agrawal
claimed_verified
2026-04-13T09:50:11.575Z
68e95674143ae4e315fff5d4
/avatars/d5e701dfe3bf9f91c790425c69923ce4.svg
Swayam Agrawal
Swayam421
user
Swayam421
69dc4bc22b6b8dc66ffeeb3e
Gautham Govind Anil
69dc4bc22b6b8dc66ffeeb3f
Prateek Jain
69dc4bc22b6b8dc66ffeeb40
Sujoy Paul
claimed_verified
2026-04-15T12:08:35.430Z
66a8a7968268a5b1a0819668
/avatars/a8cdca874279beeef1023c8ecb10403a.svg
Sujoy Paul
sujoyp
user
sujoyp
69dc4bc22b6b8dc66ffeeb41
Aditya Kusupati
ELT: Elastic Looped Transformers for Visual Generation
We introduce Elastic Looped Transformers (ELT), a highly parameter-efficient class of visual generative models based on a recurrent transformer architecture. While conventional generative models rely on deep stacks of unique transformer layers, our approach employs iterative, weight-shared transformer blocks to drastically reduce parameter counts while maintaining high synthesis quality. To effectively train these models for image and video generation, we propose the idea of Intra-Loop Self Distillation (ILSD), where student configurations (intermediate loops) are distilled from the teacher configuration (maximum training loops) to ensure consistency across the model's depth in a single training step. Our framework yields a family of elastic models from a single training run, enabling Any-Time inference capability with dynamic trade-offs between computational cost and generation quality, with the same parameter count. ELT significantly shifts the efficiency frontier for visual synthesis. With 4times reduction in parameter count under iso-inference-compute settings, ELT achieves a competitive FID of 2.0 on class-conditional ImageNet 256 times 256 and FVD of 72.8 on class-conditional UCF-101.
Elastic Looped Transformers utilize recurrent transformer architecture with weight-sharing and intra-loop self-distillation to achieve parameter-efficient visual generation with adjustable computational cost and generation quality.
recurrent transformer architecture weight-sharing parameter-efficient visual generative models Intra-Loop Self Distillation student configurations teacher configuration Any-Time inference FID FVD