Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

341

Base only

Active filters: auto-gptq

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-asym

Text Generation • 12B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-asym

Text Generation • 12B • Updated Aug 24, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 24, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs64-asym

Text Generation • 12B • Updated Aug 24, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs64-sym

Text Generation • 12B • Updated Aug 24, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int8-gs64-asym

Text Generation • 12B • Updated Aug 25, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 25, 2025 • 1

tacodevs/Rocinante-X-12B-v1-GPTQ

Updated Apr 3 • 4

groxaxo/octen-embedding-4b-w4a16

Text Generation • 0.9B • Updated Apr 30 • 157 • 1

groxaxo/octen-embedding-8b-w4a16

Text Generation • 1B • Updated Apr 30 • 240 • 1