Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,037

Full-text search

Active filters: gptq

digitous/13B-HyperMantis_GPTQ_4bit-128g

Text Generation • Updated May 24, 2023 • 9 • 12

TheBloke/guanaco-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 28 • 29

TheBloke/guanaco-33B-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 154 • 75

TheBloke/guanaco-65B-GPTQ

Text Generation • 9B • Updated Sep 27, 2023 • 1.15k • 262

TheBloke/guanaco-7B-GPTQ

Text Generation • 1B • Updated Sep 27, 2023 • 230 • 28

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 14 • 2

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 20 • 23

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 135 • 67

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • 6B • Updated Aug 21, 2023 • 350 • 197

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 27 • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • 1B • Updated Sep 27, 2023 • 60 • 26

TheBloke/Samantha-7B-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 9 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 9 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • 4B • Updated Aug 21, 2023 • 11 • 20

disarmyouwitha/koala13b_test

Text Generation • Updated May 29, 2023 • 12

TheBloke/samantha-falcon-7B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 13 • 12

TheBloke/hippogriff-30b-chat-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 63 • 13

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 204 • 85

TheBloke/WizardLM-Uncensored-Falcon-7B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 33 • 70

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 64 • 13

TheBloke/PMC_LLAMA-7B-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 15 • 4

TheBloke/based-30B-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 22 • 9

TheBloke/WizardLM-Uncensored-Falcon-40B-GPTQ

Text Generation • 6B • Updated Aug 21, 2023 • 57 • 60

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 117 • 175

TheBloke/airoboros-13b-gpt4-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 18 • 4

TheBloke/based-7B-GPTQ

Text Generation • 1B • Updated Sep 27, 2023 • 19 • 1

TheBloke/based-13b-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 32 • 7

TheBloke/airoboros-7b-gpt4-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 19 • 2

TheBloke/llama-deus-7b-v3-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 14 • 1

TheBloke/Planner-7B-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 10 • 4