EchoDistill: Bidirectional Concept Distillation for One-Step Diffusion
  Personalization
Recent advances in accelerating text-to-image (T2I) diffusion models have
enabled the synthesis of high-fidelity images even in a single step. However,
personalizing these models to incorporate novel concepts remains a challenge
due to the limited capacity of one-step models to capture new concept
distributions effectively. We propose a bidirectional concept distillation
framework, EchoDistill, to enable one-step diffusion personalization (1-SDP).
Our approach involves an end-to-end training process where a multi-step
diffusion model (teacher) and a one-step diffusion model (student) are trained
simultaneously. The concept is first distilled from the teacher model to the
student, and then echoed back from the student to the teacher. During the
EchoDistill, we share the text encoder between the two models to ensure
consistent semantic understanding. Following this, the student model is
optimized with adversarial losses to align with the real image distribution and
with alignment losses to maintain consistency with the teacher's output.
Furthermore, we introduce the bidirectional echoing refinement strategy,
wherein the student model leverages its faster generation capability to
feedback to the teacher model. This bidirectional concept distillation
mechanism not only enhances the student ability to personalize novel concepts
but also improves the generative quality of the teacher model. Our experiments
demonstrate that this collaborative framework significantly outperforms
existing personalization methods over the 1-SDP setup, establishing a novel
paradigm for rapid and effective personalization in T2I diffusion models.
68faef44f158a71c5a2f5894
Yixiong Yang
claimed_verified
2025-10-28T15:38:18.911Z
64b67f8a7bdf72299e4ce1e6
/avatars/73fd7ba62a329002a3c544169c4d3b7b.svg
YYX
liulisixin
user
liulisixin
68faef44f158a71c5a2f5895
Tao Wu
68faef44f158a71c5a2f5896
Senmao Li
68faef44f158a71c5a2f5897
Shiqi Yang
68faef44f158a71c5a2f5898
Yaxing Wang
68faef44f158a71c5a2f5899
Joost van de Weijer
68faef44f158a71c5a2f589a
Kai Wang
EchoDistill: Bidirectional Concept Distillation for One-Step Diffusion
  Personalization
Recent advances in accelerating text-to-image (T2I) diffusion models have
enabled the synthesis of high-fidelity images even in a single step. However,
personalizing these models to incorporate novel concepts remains a challenge
due to the limited capacity of one-step models to capture new concept
distributions effectively. We propose a bidirectional concept distillation
framework, EchoDistill, to enable one-step diffusion personalization (1-SDP).
Our approach involves an end-to-end training process where a multi-step
diffusion model (teacher) and a one-step diffusion model (student) are trained
simultaneously. The concept is first distilled from the teacher model to the
student, and then echoed back from the student to the teacher. During the
EchoDistill, we share the text encoder between the two models to ensure
consistent semantic understanding. Following this, the student model is
optimized with adversarial losses to align with the real image distribution and
with alignment losses to maintain consistency with the teacher's output.
Furthermore, we introduce the bidirectional echoing refinement strategy,
wherein the student model leverages its faster generation capability to
feedback to the teacher model. This bidirectional concept distillation
mechanism not only enhances the student ability to personalize novel concepts
but also improves the generative quality of the teacher model. Our experiments
demonstrate that this collaborative framework significantly outperforms
existing personalization methods over the 1-SDP setup, establishing a novel
paradigm for rapid and effective personalization in T2I diffusion models.
A bidirectional concept distillation framework enhances one-step text-to-image diffusion models by leveraging a multi-step model, improving personalization and generative quality.
text-to-image (T2I) diffusion models one-step diffusion personalization (1-SDP) bidirectional concept distillation multi-step diffusion model text encoder adversarial losses alignment losses bidirectional echoing refinement strategy