Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
text
Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
new_line
new_line
* Decrease the rank of a LoRA
text
* Decrease the rank of a LoRA
new_line
* Increase the rank of a LoRA
text
* Increase the rank of a LoRA
new_line
new_line
The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to 
text
The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to 
torch.compile()
`torch.compile()`
inline_code
 them. 
text
 them. 
new_line
new_line
Check it out here: 
text
Check it out here: 
new_line
https://huggingface.co/sayakpaul/flux-lora-resizing
sayakpaul/flux-lora-resizing
model
resource
https://huggingface.co/sayakpaul/flux-lora-resizing
Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:

* Decrease the rank of a LoRA
* Increase the rank of a LoRA

The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to `torch.compile()` them. 

Check it out here: 
https://huggingface.co/sayakpaul/flux-lora-resizing
🚀
John6666 YaTharThShaRma999 AtAndDev Joseph717171 Svngoku
🔥
John6666 YaTharThShaRma999 AtAndDev Joseph717171
👍
John6666 AtAndDev Joseph717171 louisbrulenaudet
❤️
John6666 AtAndDev Joseph717171
6640bbd0220cfa8cbfdce080
https://cdn-avatars.huggingface.co/v1/production/uploads/6640bbd0220cfa8cbfdce080/wiAHUu5ewawyipNs0YFBR.png
John Smith
John6666
user