-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
kofdai/nullai-deepseek-r1-32b
Text Generation
•
33B
•
Updated
•
486
•
1
fabricioalmeida/BumbaLM-3B-Instruct-v0.1
Text Generation
•
3B
•
Updated
•
22
•
1
MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF
Text Generation
•
21B
•
Updated
•
8.44k
•
1
Intel/Olmo-3-32B-Think-int4-AutoRound
1B
•
Updated
•
12
•
1
Shlok307/llama-1b-4bit
Text Generation
•
1B
•
Updated
•
17
•
1
ikarius/Qwen2.5-Coder-32B-Instruct-Abliterated-NF4
33B
•
Updated
•
7
•
1
Lamapi/next-codex
Text Generation
•
31B
•
Updated
•
87
•
1
mlx-community/DeepSeek-V3.2-Speciale-4bit
Text Generation
•
672B
•
Updated
•
1.14k
•
1
mlx-community/Fara-7B-4bit
Text Generation
•
1B
•
Updated
•
142
•
1
mlx-community/Trinity-Mini-4bit
Text Generation
•
26B
•
Updated
•
141
•
1
unsloth/Ministral-3-3B-Base-2512-bnb-4bit
4B
•
Updated
•
189
•
1
MaziyarPanahi/Ministral-3-8B-Reasoning-2512-GGUF
Text Generation
•
8B
•
Updated
•
284
•
1
MaziyarPanahi/Trinity-Nano-Preview-GGUF
Text Generation
•
6B
•
Updated
•
273
•
1
MaziyarPanahi/Trinity-Mini-GGUF
Text Generation
•
26B
•
Updated
•
5.91k
•
1
mlx-community/Ministral-3-8B-Instruct-2512-4bit
Updated
•
195
•
1
leonsarmiento/Hermes-4.3-36B-4bit-mlx
Text Generation
•
36B
•
Updated
•
88
•
1
leonsarmiento/Hermes-4.3-36B-6bit-mlx
Text Generation
•
36B
•
Updated
•
56
•
1
TheBloke/koala-7B-GPTQ
Text Generation
•
1B
•
Updated
•
158
•
31
TheBloke/koala-13B-GPTQ
Text Generation
•
2B
•
Updated
•
41
•
38
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
•
1B
•
Updated
•
33
•
15
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
•
5B
•
Updated
•
26
•
20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
•
2B
•
Updated
•
16
•
20
TheBloke/alpaca-lora-65B-GPTQ
Text Generation
•
9B
•
Updated
•
25
•
29
TheBloke/medalpaca-13B-GPTQ
Text Generation
•
2B
•
Updated
•
40
•
29
TheBloke/wizardLM-7B-GPTQ
Text Generation
•
1B
•
Updated
•
255
•
106
TheBloke/stable-vicuna-13B-GPTQ
Text Generation
•
2B
•
Updated
•
73
•
219
TheBloke/OpenAssistant-SFT-7-Llama-30B-GPTQ
Text Generation
•
4B
•
Updated
•
1.1k
•
35
TheBloke/wizard-vicuna-13B-GPTQ
Text Generation
•
2B
•
Updated
•
45
•
97
TheBloke/WizardLM-7B-uncensored-GPTQ
Text Generation
•
1B
•
Updated
•
481
•
195
TheBloke/GPT4All-13B-snoozy-GPTQ
Text Generation
•
2B
•
Updated
•
80
•
32