QLoRA: Efficient Finetuning of Quantized LLMs
Paper
•
2305.14314
•
Published
•
58
GGUF quants of IS-LM-3B
Original model card:
This is StableLM 3B 4E1T(Licensed under CC BY-SA 4.0.) finetuned on DataForge Economics for 3 epochs using QLoRA.
Prompt template:
USER: {prompt}
ASSISTANT:
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit