Inference Providers
Active filters: 2-bit
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 123k
• 7
Text Generation
• 15B • Updated • 124k
• 7
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
• 2B • Updated • 190k
• 7
BitDistiller/Qwen-8B-w2g64-gptq
8B • Updated • 43
• 1
MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF
Text Generation
• 4B • Updated • 129k
• 2
Text Generation
• Updated • 296
• 2
MaziyarPanahi/LFM2-24B-A2B-GGUF
Text Generation
• 24B • Updated • 485
• 2
Ayushnangia/bloom3B-2bit-gptq
Text Generation
• Updated • 8
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
• 7B • Updated • 7
• 1
nesty/sg-bart-large-4096-gptq-2bit
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
• Updated • 3
Text Generation
• 0.1B • Updated • 8
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
• 2B • Updated • 2
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
• 7B • Updated • 4
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
• 13B • Updated • 2
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
• 7B • Updated • 778
Text Generation
• 3B • Updated • 160
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 182
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 61
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 230
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 68
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 36
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 100
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 86
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 101
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 101
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 37
• 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 62
• 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 143
• 1
MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 229
• 6