Inference Providers
Active filters: 8bit
Jommarn/UNSEEN_Gemma_4_26B_NSFW-GGUF
Image-Text-to-Text
• 25B • Updated • 11k
• 67
mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation
• 35B • Updated • 9.18k
• 75
mlx-community/Qwen3.8-27B-OptiQ-4bit
Image-Text-to-Text
• 27B • Updated • 11.7k
• 18
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 58
• 11
mlx-community/Qwen3.5-2B-MLX-8bit
2B • Updated • 1.96k
• 9
mlx-community/Qwen3.5-9B-MLX-8bit
9B • Updated • 1.03k
• 14
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 4B • Updated • 9.11k
• 29
mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit
Text Generation
• 7B • Updated • 2.02k
• 17
mlx-community/gemma-4-12B-it-qat-OptiQ-4bit
Text Generation
• 12B • Updated • 2.97k
• 16
mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit
Text Generation
• 1B • Updated • 1.51k
• 6
deer-sec/CyberStag-Security-26B-A4B-V1-Q8_0-GGUF
Text Generation
• 25B • Updated • 87
• 1
MrMofer/Qwen3-27B-OBLITERATED-MLX-8bit
Image-Text-to-Text
• 27B • Updated • 420
• 4
ahmedihamdy/Ornith-1.5-35B-A3B-OptiQ-static-5.5bpw
Image-Text-to-Text
• 35B • Updated • 212
• 1
ahmedihamdy/Ornith-1.5-9B-vision-OptiQ-static-4.5bpw
Image-Text-to-Text
• 9B • Updated • 326
• 3
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 50
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 22
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 18
• 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 15
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 21
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 8
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 7
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 14
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 15
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 21
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation
• 7B • Updated • 12
• 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation
• 7B • Updated • 9
BioMistral/BioMistral-7B-BnB.8
Text Generation
• 7B • Updated • 13
alokabhishek/Llama-2-7b-chat-hf-bnb-8bit
Text Generation
• 7B • Updated • 11
• 2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation
• 7B • Updated • 16
• 2
alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2
Text Generation
• Updated • 8
• 1