Small Adapters
Collection
For More Secret Usage • 3 items • Updated
How to use tavtav/Hana-Adventure-V2 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("C:\Users\Tav\Downloads\Hamanasu-KTO-V2")
model = PeftModel.from_pretrained(base_model, "tavtav/Hana-Adventure-V2")This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from C:\Users\Tav\Downloads\Hamanasu-4B-Adventure-E6 and uses C:\Users\Tav\Downloads\Hamanasu-KTO-V2 as a base.
The following command was used to extract this LoRA adapter:
E:\Users\Tav\miniconda3\Scripts\mergekit-extract-lora --model C:\Users\Tav\Downloads\Hamanasu-4B-Adventure-E6 --base-model C:\Users\Tav\Downloads\Hamanasu-KTO-V2 --out-path C:\Users\Tav\Downloads\Hamanasu-Lora-Extracted --max-rank=128