This repo contains GGUF files for vince62s/phi-2-psy model, which is a merge of fine-tuned instruct version for phi-2.
| File | Size |
|---|---|
| vince62s-phi-2-psy_Q4_0.gguf | 1.6 GB |
| vince62s-phi-2-psy_Q4_K_M.gguf | 1.74 GB |
| vince62s-phi-2-psy_Q4_K_S.gguf | 1.63 GB |
| vince62s-phi-2-psy_Q5_K_M.gguf | 2 GB |
| vince62s-phi-2-psy_Q5_K_S.gguf | 1.93 GB |
| vince62s-phi-2-psy_Q6_K.gguf | 2.29 GB |
| vince62s-phi-2-psy_Q8_0.gguf | 2.96 GB |
| vince62s-phi-2-psy_f16.gguf | 5.56 GB |
- Downloads last month
- 36
Hardware compatibility
Log In to add your hardware
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support