Instructions to use SidXXD/HAAD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SidXXD/HAAD with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SidXXD/HAAD", dtype=torch.bfloat16, device_map="cuda") prompt = "photo of a sks person" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
End of training
Browse files- All_layer_embeds_SD_v1_5/Embeds_layer_0_VAE_Encoder.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_10_UpBLock_modified.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_11_UpBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_12_UpBLock_modified.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_13_UpBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_14_UpBLock_modified.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_15_Conv_out.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_16_Conv_out_modified.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_1_Conv_in.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_2_DownBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_3_DownBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_4_DownBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_5_DownBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_6_MidBlock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_7_UpBLock.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_8_UpBLock_modified.pt +3 -0
- All_layer_embeds_SD_v1_5/Embeds_layer_9_UpBLock.pt +3 -0
- README.md +22 -0
- logs/custom-diffusion/1756734348.8486567/events.out.tfevents.1756734348.cudahpc06.193995.1 +3 -0
- logs/custom-diffusion/1756734348.8503017/hparams.yml +58 -0
- logs/custom-diffusion/1756734380.5819595/events.out.tfevents.1756734380.cudahpc06.195804.1 +3 -0
- logs/custom-diffusion/1756734380.5836616/hparams.yml +58 -0
- logs/custom-diffusion/events.out.tfevents.1756734348.cudahpc06.193995.0 +3 -0
- logs/custom-diffusion/events.out.tfevents.1756734380.cudahpc06.195804.0 +3 -0
- pytorch_custom_diffusion_weights.bin +3 -0
- sks.bin +3 -0
All_layer_embeds_SD_v1_5/Embeds_layer_0_VAE_Encoder.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f33c7117da5176f6a1c0d5bacb12bb592332dd031e5f853b207726f99e57b3ab
|
| 3 |
+
size 66404
|
All_layer_embeds_SD_v1_5/Embeds_layer_10_UpBLock_modified.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:586ea3b5a1cce0ba8c43e87c12d70b9fc75e38eeb8842b75f2b00ee1212ede5f
|
| 3 |
+
size 5243830
|
All_layer_embeds_SD_v1_5/Embeds_layer_11_UpBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0095a5c06ca77c5cd9d42364620d4dc4e2a823ccc2d42ef877b13397340d4e35
|
| 3 |
+
size 10486619
|
All_layer_embeds_SD_v1_5/Embeds_layer_12_UpBLock_modified.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:efe46bd37ba7ee19cab61d3c7823deb9890d96bd424cc8c60a941c12d2373b66
|
| 3 |
+
size 10486710
|
All_layer_embeds_SD_v1_5/Embeds_layer_13_UpBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e1344fb5ed5b52c792d076ee6d2911755eb4d834450e83c3ee3135b761a4495a
|
| 3 |
+
size 5243739
|
All_layer_embeds_SD_v1_5/Embeds_layer_14_UpBLock_modified.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ba398cb20e8e0ffdb79f7a468aa59f7ee4a85594363a3ab2c9f4b1680b2ab687
|
| 3 |
+
size 5243830
|
All_layer_embeds_SD_v1_5/Embeds_layer_15_Conv_out.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6723270b26479a0486d5a6dbdde5f1d1d4738a5ac7378779dff3d8f2b0fe1449
|
| 3 |
+
size 66398
|
All_layer_embeds_SD_v1_5/Embeds_layer_16_Conv_out_modified.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:adda00c1b1040b71b382139fcbee35ff882533f32da473473b7809bd8f07a0c9
|
| 3 |
+
size 66489
|
All_layer_embeds_SD_v1_5/Embeds_layer_1_Conv_in.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8b412a9cd10e2704fd84e616ae5f6d15a232eadbbf12aea0803383db4fa14b05
|
| 3 |
+
size 5243736
|
All_layer_embeds_SD_v1_5/Embeds_layer_2_DownBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e1cc2fb3ad21d50156de71d0915e94d1ed53c0fedeb29dbc456cf1ab7c9709be
|
| 3 |
+
size 1311582
|
All_layer_embeds_SD_v1_5/Embeds_layer_3_DownBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b750dfb08da2a9b3ad0be0f80c7a6502353926f623ea9feedaf04914810c1dff
|
| 3 |
+
size 656222
|
All_layer_embeds_SD_v1_5/Embeds_layer_4_DownBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1c8c0e857fb80f0b31ca363f0350eddd32f859f99467d39bd4991744588f752f
|
| 3 |
+
size 328542
|
All_layer_embeds_SD_v1_5/Embeds_layer_5_DownBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a31dcf5a037db076f9517730abdda57188a46128a3be6c081720639c677b506
|
| 3 |
+
size 328542
|
All_layer_embeds_SD_v1_5/Embeds_layer_6_MidBlock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c48e275bc120e699946d5d1928ddb820baf12535fc0c1b96c801d189d97bf016
|
| 3 |
+
size 328539
|
All_layer_embeds_SD_v1_5/Embeds_layer_7_UpBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1f9ad6ba30a518894e02ace4a521a228e07249b6c357471850800e276fdf547b
|
| 3 |
+
size 1311576
|
All_layer_embeds_SD_v1_5/Embeds_layer_8_UpBLock_modified.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db7e36b595c3fc1906f8c061cb70712a36322e396105d1155abcadc3c0dcb9fc
|
| 3 |
+
size 1311667
|
All_layer_embeds_SD_v1_5/Embeds_layer_9_UpBLock.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb072627a6b0f78b3b3d971068357396c8610f1fc1075718ff4ca148f91b72af
|
| 3 |
+
size 5243736
|
README.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
---
|
| 3 |
+
license: creativeml-openrail-m
|
| 4 |
+
base_model: runwayml/stable-diffusion-v1-5
|
| 5 |
+
instance_prompt: photo of a sks person
|
| 6 |
+
tags:
|
| 7 |
+
- stable-diffusion
|
| 8 |
+
- stable-diffusion-diffusers
|
| 9 |
+
- text-to-image
|
| 10 |
+
- diffusers
|
| 11 |
+
- custom-diffusion
|
| 12 |
+
inference: true
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Custom Diffusion - SidXXD/HAAD
|
| 16 |
+
|
| 17 |
+
These are Custom Diffusion adaption weights for runwayml/stable-diffusion-v1-5. The weights were trained on photo of a sks person using [Custom Diffusion](https://www.cs.cmu.edu/~custom-diffusion). You can find some example images in the following.
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
|
| 21 |
+
|
| 22 |
+
For more details on the training, please follow [this link](https://github.com/huggingface/diffusers/blob/main/examples/custom_diffusion).
|
logs/custom-diffusion/1756734348.8486567/events.out.tfevents.1756734348.cudahpc06.193995.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7e795fc6b6e8fe3571492d1ade0aed6dd30e803c432b46d584503c17cd6b2043
|
| 3 |
+
size 2785
|
logs/custom-diffusion/1756734348.8503017/hparams.yml
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: false
|
| 6 |
+
attn_maps_path_name: attn_maps_color
|
| 7 |
+
center_crop: false
|
| 8 |
+
checkpointing_steps: 250
|
| 9 |
+
checkpoints_total_limit: null
|
| 10 |
+
class_data_dir: null
|
| 11 |
+
class_prompt: null
|
| 12 |
+
concepts_list: null
|
| 13 |
+
dataloader_num_workers: 2
|
| 14 |
+
enable_xformers_memory_efficient_attention: false
|
| 15 |
+
freeze_model: crossattn_kv
|
| 16 |
+
gradient_accumulation_steps: 1
|
| 17 |
+
gradient_checkpointing: false
|
| 18 |
+
hflip: true
|
| 19 |
+
hub_model_id: null
|
| 20 |
+
hub_token: null
|
| 21 |
+
initializer_token: ktn
|
| 22 |
+
instance_data_dir: /home/xide/miniconda3/code/Attack/HAAD/outputs/1972/250
|
| 23 |
+
instance_prompt: photo of a sks person
|
| 24 |
+
learning_rate: 1.0e-05
|
| 25 |
+
local_rank: -1
|
| 26 |
+
logging_dir: logs
|
| 27 |
+
lr_scheduler: constant
|
| 28 |
+
lr_warmup_steps: 0
|
| 29 |
+
max_grad_norm: 1.0
|
| 30 |
+
max_train_steps: 250
|
| 31 |
+
mixed_precision: null
|
| 32 |
+
modifier_token: sks
|
| 33 |
+
no_safe_serialization: true
|
| 34 |
+
noaug: false
|
| 35 |
+
num_class_images: 200
|
| 36 |
+
num_train_epochs: 1
|
| 37 |
+
num_validation_images: 2
|
| 38 |
+
output_dir: /home/xide/miniconda3/code/diffusers_old/examples/custom_diffusion/model/HAAD
|
| 39 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 40 |
+
prior_generation_precision: null
|
| 41 |
+
prior_loss_weight: 0
|
| 42 |
+
push_to_hub: true
|
| 43 |
+
real_prior: false
|
| 44 |
+
report_to: tensorboard
|
| 45 |
+
resolution: 512
|
| 46 |
+
resume_from_checkpoint: null
|
| 47 |
+
revision: null
|
| 48 |
+
sample_batch_size: 4
|
| 49 |
+
scale_lr: true
|
| 50 |
+
seed: 42
|
| 51 |
+
set_grads_to_none: false
|
| 52 |
+
tokenizer_name: null
|
| 53 |
+
train_batch_size: 2
|
| 54 |
+
use_8bit_adam: false
|
| 55 |
+
validation_prompt: null
|
| 56 |
+
validation_steps: 50
|
| 57 |
+
variant: null
|
| 58 |
+
with_prior_preservation: false
|
logs/custom-diffusion/1756734380.5819595/events.out.tfevents.1756734380.cudahpc06.195804.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:034dfbf8bff707ee387bf93e51d7c70e1e40ed9c0ab196fe005cc7f2d32c8485
|
| 3 |
+
size 2785
|
logs/custom-diffusion/1756734380.5836616/hparams.yml
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: false
|
| 6 |
+
attn_maps_path_name: attn_maps_color
|
| 7 |
+
center_crop: false
|
| 8 |
+
checkpointing_steps: 250
|
| 9 |
+
checkpoints_total_limit: null
|
| 10 |
+
class_data_dir: null
|
| 11 |
+
class_prompt: null
|
| 12 |
+
concepts_list: null
|
| 13 |
+
dataloader_num_workers: 2
|
| 14 |
+
enable_xformers_memory_efficient_attention: false
|
| 15 |
+
freeze_model: crossattn_kv
|
| 16 |
+
gradient_accumulation_steps: 1
|
| 17 |
+
gradient_checkpointing: false
|
| 18 |
+
hflip: true
|
| 19 |
+
hub_model_id: null
|
| 20 |
+
hub_token: null
|
| 21 |
+
initializer_token: ktn
|
| 22 |
+
instance_data_dir: /home/xide/miniconda3/code/Attack/HAAD/outputs/1972/250
|
| 23 |
+
instance_prompt: photo of a sks person
|
| 24 |
+
learning_rate: 1.0e-05
|
| 25 |
+
local_rank: -1
|
| 26 |
+
logging_dir: logs
|
| 27 |
+
lr_scheduler: constant
|
| 28 |
+
lr_warmup_steps: 0
|
| 29 |
+
max_grad_norm: 1.0
|
| 30 |
+
max_train_steps: 250
|
| 31 |
+
mixed_precision: null
|
| 32 |
+
modifier_token: sks
|
| 33 |
+
no_safe_serialization: true
|
| 34 |
+
noaug: false
|
| 35 |
+
num_class_images: 200
|
| 36 |
+
num_train_epochs: 1
|
| 37 |
+
num_validation_images: 2
|
| 38 |
+
output_dir: /home/xide/miniconda3/code/diffusers_old/examples/custom_diffusion/model/HAAD
|
| 39 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 40 |
+
prior_generation_precision: null
|
| 41 |
+
prior_loss_weight: 0
|
| 42 |
+
push_to_hub: true
|
| 43 |
+
real_prior: false
|
| 44 |
+
report_to: tensorboard
|
| 45 |
+
resolution: 512
|
| 46 |
+
resume_from_checkpoint: null
|
| 47 |
+
revision: null
|
| 48 |
+
sample_batch_size: 4
|
| 49 |
+
scale_lr: true
|
| 50 |
+
seed: 42
|
| 51 |
+
set_grads_to_none: false
|
| 52 |
+
tokenizer_name: null
|
| 53 |
+
train_batch_size: 2
|
| 54 |
+
use_8bit_adam: false
|
| 55 |
+
validation_prompt: null
|
| 56 |
+
validation_steps: 50
|
| 57 |
+
variant: null
|
| 58 |
+
with_prior_preservation: false
|
logs/custom-diffusion/events.out.tfevents.1756734348.cudahpc06.193995.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cfdb228d633626f7f16a7ffa78e22ab3000b8e2684874087da73a6992da0cca8
|
| 3 |
+
size 88
|
logs/custom-diffusion/events.out.tfevents.1756734380.cudahpc06.195804.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:30e920dd920b97ffea4e69e2cccff5449a558671edd4bd3184a33639a7cc7c95
|
| 3 |
+
size 20834
|
pytorch_custom_diffusion_weights.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c427bf79b3c142cab5ff237579adffd49167ae046de8f6f7ade4312fc2007b4b
|
| 3 |
+
size 76691351
|
sks.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:16c4cfc798711e8be7b6b0f96bb8bba4b40f43114e2ea7ddea60cd6028e7c3d7
|
| 3 |
+
size 151785119
|