Full Fine Tuning of FLUX yields way better results than LoRA training as expected, overfitting and bleeding reduced a lot
text
Full Fine Tuning of FLUX yields way better results than LoRA training as expected, overfitting and bleeding reduced a lot
new_line
new_line
Configs and Full Experiments
text
Configs and Full Experiments
new_line
Full configs and grid files shared here : 
text
Full configs and grid files shared here : 
https://www.patreon.com/posts/kohya-flux-fine-112099700
https://www.patreon.com/posts/kohya-flux-fine-112099700
link
new_line
new_line
Details
text
Details
new_line
I am still rigorously testing different hyperparameters and comparing impact of each one to find the best workflow
text
I am still rigorously testing different hyperparameters and comparing impact of each one to find the best workflow
new_line
So far done 16 different full trainings and completing 8 more at the moment
text
So far done 16 different full trainings and completing 8 more at the moment
new_line
I am using my poor overfit 15 images dataset for experimentation (4th image)
text
I am using my poor overfit 15 images dataset for experimentation (4th image)
new_line
I have already proven that when I use a better dataset it becomes many times betters and generate expressions perfectly
text
I have already proven that when I use a better dataset it becomes many times betters and generate expressions perfectly
new_line
Here example case : 
text
Here example case : 
https://www.reddit.com/r/FluxAI/comments/1ffz9uc/tried_expressions_with_flux_lora_training_with_my/
https://www.reddit.com/r/FluxAI/comments/1ffz9uc/tried_expressions_with_flux_lora_training_with_my/
link
new_line
Conclusions
text
Conclusions
new_line
When the results are analyzed, Fine Tuning is way lesser overfit and more generalized and better quality
text
When the results are analyzed, Fine Tuning is way lesser overfit and more generalized and better quality
new_line
In first 2 images, it is able to change hair color and add beard much better, means lesser overfit
text
In first 2 images, it is able to change hair color and add beard much better, means lesser overfit
new_line
In the third image, you will notice that the armor is much better, thus lesser overfit
text
In the third image, you will notice that the armor is much better, thus lesser overfit
new_line
I noticed that the environment and clothings are much lesser overfit and better quality
text
I noticed that the environment and clothings are much lesser overfit and better quality
new_line
Disadvantages
text
Disadvantages
new_line
Kohya still doesn’t have FP8 training, thus 24 GB GPUs gets a huge speed drop
text
Kohya still doesn’t have FP8 training, thus 24 GB GPUs gets a huge speed drop
new_line
Moreover, 48 GB GPUs has to use Fused Back Pass optimization, thus have some speed drop
text
Moreover, 48 GB GPUs has to use Fused Back Pass optimization, thus have some speed drop
new_line
16 GB GPUs gets way more aggressive speed drop due to lack of FP8
text
16 GB GPUs gets way more aggressive speed drop due to lack of FP8
new_line
Clip-L and T5 trainings still not supported
text
Clip-L and T5 trainings still not supported
new_line
Speeds
text
Speeds
new_line
Rank 1 Fast Config — uses 27.5 GB VRAM, 6.28 second / it (LoRA is 4.85 second / it)
text
Rank 1 Fast Config — uses 27.5 GB VRAM, 6.28 second / it (LoRA is 4.85 second / it)
new_line
Rank 1 Slower Config — uses 23.1 GB VRAM, 14.12 second / it (LoRA is 4.85 second / it)
text
Rank 1 Slower Config — uses 23.1 GB VRAM, 14.12 second / it (LoRA is 4.85 second / it)
new_line
Rank 1 Slowest Config — uses 15.5 GB VRAM, 39 second / it (LoRA is 6.05 second / it)
text
Rank 1 Slowest Config — uses 15.5 GB VRAM, 39 second / it (LoRA is 6.05 second / it)
new_line
Final Info
text
Final Info
new_line
Saved checkpoints are FP16 and thus 23.8 GB (no Clip-L or T5 trained)
text
Saved checkpoints are FP16 and thus 23.8 GB (no Clip-L or T5 trained)
new_line
According to the Kohya, applied optimizations doesn’t change quality so all configs are ranked as Rank 1 at the moment
text
According to the Kohya, applied optimizations doesn’t change quality so all configs are ranked as Rank 1 at the moment
new_line
I am still testing whether these optimizations make any impact on quality or not
text
I am still testing whether these optimizations make any impact on quality or not
Full Fine Tuning of FLUX yields way better results than LoRA training as expected, overfitting and bleeding reduced a lot

Configs and Full Experiments
Full configs and grid files shared here : https://www.patreon.com/posts/kohya-flux-fine-112099700

Details
I am still rigorously testing different hyperparameters and comparing impact of each one to find the best workflow
So far done 16 different full trainings and completing 8 more at the moment
I am using my poor overfit 15 images dataset for experimentation (4th image)
I have already proven that when I use a better dataset it becomes many times betters and generate expressions perfectly
Here example case : https://www.reddit.com/r/FluxAI/comments/1ffz9uc/tried_expressions_with_flux_lora_training_with_my/
Conclusions
When the results are analyzed, Fine Tuning is way lesser overfit and more generalized and better quality
In first 2 images, it is able to change hair color and add beard much better, means lesser overfit
In the third image, you will notice that the armor is much better, thus lesser overfit
I noticed that the environment and clothings are much lesser overfit and better quality
Disadvantages
Kohya still doesn’t have FP8 training, thus 24 GB GPUs gets a huge speed drop
Moreover, 48 GB GPUs has to use Fused Back Pass optimization, thus have some speed drop
16 GB GPUs gets way more aggressive speed drop due to lack of FP8
Clip-L and T5 trainings still not supported
Speeds
Rank 1 Fast Config — uses 27.5 GB VRAM, 6.28 second / it (LoRA is 4.85 second / it)
Rank 1 Slower Config — uses 23.1 GB VRAM, 14.12 second / it (LoRA is 4.85 second / it)
Rank 1 Slowest Config — uses 15.5 GB VRAM, 39 second / it (LoRA is 6.05 second / it)
Final Info
Saved checkpoints are FP16 and thus 23.8 GB (no Clip-L or T5 trained)
According to the Kohya, applied optimizations doesn’t change quality so all configs are ranked as Rank 1 at the moment
I am still testing whether these optimizations make any impact on quality or not
🔥
MonsterMMORPG runebloodstone KingNish Will114 antoinejeannot Sergidev nbroad eugenesiow
🚀
MonsterMMORPG tazztone John6666
👍
MonsterMMORPG tazztone tayyabmehar27
👀
MonsterMMORPG tazztone
❤️
MonsterMMORPG
🤗
MonsterMMORPG
😎
MonsterMMORPG
➕
MonsterMMORPG
🧠
MonsterMMORPG
🤝
MonsterMMORPG
🤯
MonsterMMORPG
648c09171c113a0526258989
/avatars/b333883eab390c3d57f4c0f989c20063.svg
tazz tone
tazztone
user
6345bd89fe134dfd7a0dba40
https://cdn-avatars.huggingface.co/v1/production/uploads/6345bd89fe134dfd7a0dba40/72EZjBiatKqqsu96txd_v.jpeg
Furkan Gözükara
MonsterMMORPG
user