Instructions to use nphSi/Z-Image-Lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use nphSi/Z-Image-Lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Tongyi-MAI/Z-Image,Tongyi-MAI/Z-Image-Turbo", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("nphSi/Z-Image-Lora") prompt = "Alexandra Chando (vrtlAlexandraChando)" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Krea 2 Loras?
Do you think you'll train any loras for Krea 2? I just tried training one as an experiment and it turned out pretty good, I imagine yours would be even better!
Unlikely. Maybe for a test when OT/RunPod is back on track.
I also did some extensive A/B testing today using both my custom trained LoRAs for the same character based on the same dataset.
Krea 2 has definitely taken a noticeable step up compared to Z-Image. Surfaces, textures, fabrics, hair, skin – everything looks way more realistic, and some parts, like the hair, are insanely detailed.
The prompt adherence is also a lot better, even compared to Z-Image Base (which I use with my own distilled finetune, since Base sticks to prompts way better than Turbo). Some poses aren't even possible with Z-Image.
Anyway, for a local base model without any realism LoRAs or other fine tunes yet, this is really impressive, and I don't think I'll bother training for Z-Image anymore. The training times are pretty similar too, at least with the settings I've been using for Z-Image so far (multi-resolution, 1024, 512 minimum). It usually takes about 1 to 2 hours per LoRA on a 5090.
Too bad there’s no support in Onetrainer yet, but I'm sure that's coming. In the meantime, I'll keep training a few of my datasets via AI Toolkit.
By the way, I wrote myself a GPU sniper via the Runpod API—it spins up a 5090 pod with either the AI Toolkit or Onetrainer template within 15 to 20 minutes max. If you're interested in that, nphSI, hit me up. ;)
I like prompt 17. Dont know why, cant think with 30C in room...
Need to wait for proper GGUF support in Comfy for both model and TE before i can test. I doubt i will be happy with Q4 quality...
Need to wait for proper GGUF support in Comfy for both model and TE before i can test. I doubt i will be happy with Q4 quality...
Both fp8 models are working fine on my 16 GB 4070 Ti with ComfyUI's smart memory management.
Hi there, thanks for sharing all these LoRAs. Surprisingly, your vrtlRihanna LoRA that you trained on ZiT is also working with Krea 2 Turbo... but only the Rihanna LoRA is working. Do you remember how you trained it compared to the other ones?
I've also trained about 10 ZiT LoRAs with AI Toolkit, but none of them are working with Krea 2. Only your vrtlRihanna is working... pretty impressive!
I am pretty sure its not working, its just that krea2´s knowledge about Rihanna is very good in the base model.
All loras here are trained on ZI Base, ZI DeTurbo version have been removed/replaced long ago.
OneTrainer now supports Krea2 as well.
And just like with Z-Image, training Krea2 models is way faster here than with AI-Toolkit. My settings for the 5090: Standard OneTrainer Krea preset, but regular AdamW (not AdamW-8Bit), batch size 1 instead of 2, cosine scheduler, and masked training turned on.
For a quick comparison, I ran one of my 30-image datasets for 100 epochs (= 3000 steps)—once at 512px resolution, and once mixed 1024px and 512px (1024,512). The 512px training took just under 17 minutes, while the 1024,512 run took a little over 40 minutes (without sample generation). AI-Toolkit took twice as long. Good and usable results started popping up around 2200-2400 steps.
The quality with the 1024 LoRA is on another level. It’s really noticeable starting right from cowboy shots / half-body portraits—and obviously, the closer you get to the character, the bigger the difference. With the exact same prompt, you get more and finer details, way better skin textures and skin tones, as well as better color resolution and rendering overall. You can see this for example by comparing gradients in blue skies. But yeah, that was already the case with Z-Image anyway.