Reflection Removal through Efficient Adaptation of Diffusion Transformers
We introduce a diffusion-transformer (DiT) framework for single-image reflection removal that leverages the generalization strengths of foundation diffusion models in the restoration setting. Rather than relying on task-specific architectures, we repurpose a pre-trained DiT-based foundation model by conditioning it on reflection-contaminated inputs and guiding it toward clean transmission layers. We systematically analyze existing reflection removal data sources for diversity, scalability, and photorealism. To address the shortage of suitable data, we construct a physically based rendering (PBR) pipeline in Blender, built around the Principled BSDF, to synthesize realistic glass materials and reflection effects. Efficient LoRA-based adaptation of the foundation model, combined with the proposed synthetic data, achieves state-of-the-art performance on in-domain and zero-shot benchmarks. These results demonstrate that pretrained diffusion transformers, when paired with physically grounded data synthesis and efficient adaptation, offer a scalable and high-fidelity solution for reflection removal. Project page: https://hf.co/spaces/huawei-bayerlab/windowseat-reflection-removal-web
6932ea5a3962c926cf6803f2
Daniyar Zakarin
claimed_verified
2025-12-08T08:31:30.502Z
68026b5930403e824489d5ef
/avatars/4e3119525dd14ac7f6ae4b1c0bc251ef.svg
Daniyar Zakarin
daniyarzt
user
daniyarzt
6932ea5a3962c926cf6803f3
Thiemo Wandel
claimed_verified
2025-12-08T08:31:28.486Z
64a4d80c33ded98516cf5cf4
/avatars/da22b5cebd02532a1c03583b02baf358.svg
Thiemo Wandel
thiemo-wandel
user
thiemo-wandel
6932ea5a3962c926cf6803f4
Anton Obukhov
claimed_verified
2025-12-08T08:31:32.445Z
62f93abbc4817cfc0756b6f8
https://cdn-avatars.huggingface.co/v1/production/uploads/62f93abbc4817cfc0756b6f8/2TUC739huKDji_fKwykuh.jpeg
Anton Obukhov
toshas
user
toshas
6932ea5a3962c926cf6803f5
Dengxin Dai
Reflection Removal through Efficient Adaptation of Diffusion Transformers
We introduce a diffusion-transformer (DiT) framework for single-image reflection removal that leverages the generalization strengths of foundation diffusion models in the restoration setting. Rather than relying on task-specific architectures, we repurpose a pre-trained DiT-based foundation model by conditioning it on reflection-contaminated inputs and guiding it toward clean transmission layers. We systematically analyze existing reflection removal data sources for diversity, scalability, and photorealism. To address the shortage of suitable data, we construct a physically based rendering (PBR) pipeline in Blender, built around the Principled BSDF, to synthesize realistic glass materials and reflection effects. Efficient LoRA-based adaptation of the foundation model, combined with the proposed synthetic data, achieves state-of-the-art performance on in-domain and zero-shot benchmarks. These results demonstrate that pretrained diffusion transformers, when paired with physically grounded data synthesis and efficient adaptation, offer a scalable and high-fidelity solution for reflection removal. Project page: https://hf.co/spaces/huawei-bayerlab/windowseat-reflection-removal-web
Pretrained diffusion transformers, adapted with LoRA and synthetic PBR data, achieve state-of-the-art reflection removal performance.
diffusion-transformer DiT foundation diffusion models reflection removal reflection-contaminated inputs clean transmission layers physically based rendering PBR Blender Principled BSDF LoRA state-of-the-art in-domain zero-shot benchmarks physically grounded data synthesis