databricks/databricks-dolly-15k
Viewer • Updated • 15k • 34k • 969
How to use LukeOLuck/llama2-7-dolly-query with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("NousResearch/Llama-2-7b-chat-hf")
model = PeftModel.from_pretrained(base_model, "LukeOLuck/llama2-7-dolly-query")This model is a fine-tuned version of Llama-2-7b-chat-hf on the generator dataset. Can be used in conjunction with LukeOLuck/llama2-7-dolly-answer
A Fine-Tuned PEFT Adapter for the llama2 7b chat hf model Leverages FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness, QLoRA: Efficient Finetuning of Quantized LLMs, and PEFT
Generate a query based on context and input
Used SFTTrainer, checkout the code
The following hyperparameters were used during training:
Base model
meta-llama/Llama-2-7b-chat