Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

40

Base only

Active filters: group-size-64

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 81 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 45 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 20 • 1

lukaskremla/Qwen3.8-27B-6bit-MLX-TextOnly

Text Generation • 27B • Updated Sep 1 • 249

lukaskremla/Qwen3.8-27B-5bit-MLX-TextOnly

Text Generation • 27B • Updated Sep 1 • 255

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 27B • Updated Sep 1 • 4.17k • 18

lukaskremla/Qwen3.8-27B-2bit-MLX-TextOnly

Text Generation • 27B • Updated Sep 1 • 2.18k • 6

lukaskremla/Qwen3.8-27B-8bit-MLX-TextOnly

Text Generation • 27B • Updated Sep 1 • 310 • 1

lukaskremla/Qwen3.8-27B-4bit-MLX-TextOnly

Text Generation • 27B • Updated Sep 1 • 1.05k • 4

lukaskremla/Qwen3.8-27B-8bit-MLX

Image-Text-to-Text • 27B • Updated Aug 15 • 99

lukaskremla/Qwen3.8-27B-6bit-MLX

Image-Text-to-Text • 27B • Updated Aug 15 • 106

lukaskremla/Qwen3.8-27B-5bit-MLX

Image-Text-to-Text • 27B • Updated Aug 15 • 75

lukaskremla/Qwen3.8-27B-4bit-MLX

Image-Text-to-Text • 27B • Updated Aug 15 • 163

lukaskremla/Qwen3.8-27B-3bit-MLX

Image-Text-to-Text • 27B • Updated Aug 15 • 1.31k • 5

lukaskremla/Qwen3.8-27B-2bit-MLX

Image-Text-to-Text • 27B • Updated Aug 15 • 472 • 1

lukaskremla/Qwen3.8-27B-MTP-8bit-MLX

Text Generation • 0.4B • Updated Aug 15 • 165

lukaskremla/Qwen3.8-27B-MTP-6bit-MLX

Text Generation • 0.4B • Updated Aug 15 • 183

lukaskremla/Qwen3.8-27B-MTP-5bit-MLX

Text Generation • 0.4B • Updated Aug 15 • 182

lukaskremla/Qwen3.8-27B-MTP-4bit-MLX

Text Generation • 0.4B • Updated Aug 15 • 167

lukaskremla/Qwen3.8-27B-MTP-3bit-MLX

Text Generation • 0.4B • Updated Aug 15 • 457 • 1

lukaskremla/Qwen3.8-27B-MTP-2bit-MLX

Text Generation • 0.4B • Updated Aug 15 • 343 • 1

lukaskremla/Ornith-1.5-35B-A3B-MTP-2bit-MLX

Text Generation • 0.8B • Updated Sep 1 • 58

lukaskremla/Ornith-1.5-35B-A3B-MTP-3bit-MLX

Text Generation • 0.8B • Updated Sep 1 • 63

lukaskremla/Ornith-1.5-35B-A3B-MTP-4bit-MLX

Text Generation • 0.8B • Updated Sep 1 • 200

lukaskremla/Ornith-1.5-35B-A3B-MTP-5bit-MLX

Text Generation • 0.8B • Updated Sep 1 • 57

lukaskremla/Ornith-1.5-35B-A3B-MTP-6bit-MLX

Text Generation • 0.8B • Updated Sep 1 • 80

lukaskremla/Ornith-1.5-35B-A3B-MTP-8bit-MLX

Text Generation • 0.8B • Updated Sep 1 • 155

lukaskremla/Ornith-1.5-35B-A3B-3bit-MLX-TextOnly

Text Generation • 35B • Updated Sep 1 • 180

lukaskremla/Ornith-1.5-35B-A3B-2bit-MLX-TextOnly

Text Generation • 35B • Updated Sep 1 • 77

lukaskremla/Ornith-1.5-35B-A3B-4bit-MLX-TextOnly

Text Generation • 35B • Updated Sep 1 • 88