Inference Providers
Active filters: 3-bit
manjunathshiva/gpt-oss-20b-tq3
Text Generation
• 22B • Updated • 3.29k
• 46
deucebucket/Qwen3.6-35B-A3B-Cerebellum-GGUF
Text Generation
• 35B • Updated • 946
• 8
deucebucket/Gemma-4-26B-A4B-it-Cerebellum-v6-GGUF
Image-Text-to-Text
• 25B • Updated • 2.87k
• 9
88B • Updated • 40.2k
• 13
unsloth/Qwen3.6-35B-A3B-UD-MLX-3bit
Image-Text-to-Text
• 5B • Updated • 14.8k
• 8
majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-3bit
Image-Text-to-Text
• 35B • Updated • 3k
• 5
deucebucket/Gemma-4-E4B-it-Cerebellum-v2-GGUF
Image-Text-to-Text
• 8B • Updated • 588
• 3
MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF
Text Generation
• 141B • Updated • 104k
• 77
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 101k
• 8
MaziyarPanahi/gemma-3-12b-it-GGUF
Text Generation
• 12B • Updated • 101k
• 19
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
• 8B • Updated • 220k
• 10
mlx-community/MiniMax-M2.5-3bit
Text Generation
• 229B • Updated • 669
• 11
MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit
Text Generation
• 121B • Updated • 796
• 4
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-3bit
Image-Text-to-Text
• 35B • Updated • 1.9k
• 3
mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-3Bit
Text Generation
• 27B • Updated • 1.1k
• 1
deucebucket/Gemma-4-26B-A4B-it-Cerebellum-GGUF
Text Generation
• 25B • Updated • 699
• 4
deucebucket/Gemma-4-E2B-it-Cerebellum-v2-GGUF
Image-Text-to-Text
• 5B • Updated • 452
• 3
DeathGodlike/IlyaGusev_saiga-nemo-12b_EXL3
Text Generation
• Updated • 4
• 1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
• Updated • 6
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 10
• 3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 15
• 3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
• Updated • 10
Text Generation
• Updated • 14
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
• Updated • 14
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
• 6B • Updated • 4
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
• 6B • Updated • 6
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
• 3B • Updated • 3
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
• 3B • Updated • 7
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
• 31B • Updated • 5
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
Text Generation
• 65B • Updated • 8