Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,900

Full-text search

Active filters: gptq

arturoguizar/Llama-2-7b-hf-GPTQ

Text Generation • Updated Jul 16, 2024 • 19

alouafi/Meta-llama-3-8B-Instruct-GPTQ

Text Generation • Updated Jul 16, 2024 • 18

shuyuej/Command-R-GPTQ

Text Generation • Updated Jul 25, 2024 • 26 • 1

kushagrrrr/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Jul 16, 2024 • 20

thesven/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 16, 2024 • 22

Toby0830/internlm2_5-7b-chat-1m-gptq-8bits

Feature Extraction • Updated Jul 16, 2024 • 16 • 1

Xu-Ouyang/pythia-70m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 24

Xu-Ouyang/pythia-70m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 24

Xu-Ouyang/pythia-70m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 24

Xu-Ouyang/pythia-70m-deduped-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 21

Xu-Ouyang/pythia-70m-deduped-int3-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 29

Xu-Ouyang/pythia-70m-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int3-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 23

Xu-Ouyang/pythia-70m-deduped-int3-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 26

Xu-Ouyang/pythia-70m-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 24

Xu-Ouyang/pythia-70m-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 24

Xu-Ouyang/pythia-70m-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 27

Xu-Ouyang/pythia-70m-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 9, 2024 • 23

Xu-Ouyang/pythia-70m-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 9, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 23

Xu-Ouyang/pythia-70m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 22

Xu-Ouyang/pythia-70m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 21

28Smiles/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Jul 17, 2024 • 27

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated Sep 25, 2024 • 27

alouafi/Meta-llama-3-8B-Instruct-GPTQ-temp

Text Generation • Updated Jul 17, 2024 • 18

luis5tb/prometheus-eval-8x7b-gptq-marlin-vmwareds-4096

Text Generation • Updated Jul 17, 2024 • 21