Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

20,605

Full-text search

Active filters: 4-bit

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 4.84k • 2

TheBloke/dopeystableplats-3b-v1-GPTQ

Text Generation • Updated Dec 12, 2023 • 18

TheBloke/neural-chat-7B-v3-3-AWQ

Text Generation • Updated Dec 12, 2023 • 39

TheBloke/neural-chat-7B-v3-3-GPTQ

Text Generation • Updated Dec 12, 2023 • 53 • 3

TheBloke/AmberChat-GPTQ

Text Generation • Updated Dec 12, 2023 • 17 • 1

TheBloke/AmberChat-AWQ

Text Generation • Updated Dec 12, 2023 • 15 • 1

TheBloke/Amber-GPTQ

Text Generation • Updated Dec 12, 2023 • 15 • 1

TheBloke/Amber-AWQ

Text Generation • Updated Dec 12, 2023 • 18 • 1

TheBloke/Seraph-7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 19

TheBloke/Seraph-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 15

iproskurina/opt-13b-GPTQ-4bit-g128

Text Generation • Updated Sep 24, 2024 • 27

TheBloke/v1olet_marcoroni-go-bruins-merge-7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 16 • 1

TheBloke/v1olet_marcoroni-go-bruins-merge-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 15

TheBloke/Merged-DPO-7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 22

TheBloke/Merged-DPO-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 15 • 1

aladaf/zephyr-7b-beta_standard_v0.1_gptq

Text Generation • Updated Dec 12, 2023 • 17

TheBloke/supermario-v2-GPTQ

Text Generation • Updated Dec 12, 2023 • 16 • 1

TheBloke/supermario-v2-AWQ

Text Generation • Updated Dec 12, 2023 • 16 • 1

TheBloke/Pallas-0.3-GPTQ

Text Generation • Updated Dec 12, 2023 • 25 • 1

TheBloke/Pallas-0.3-AWQ

Text Generation • Updated Dec 12, 2023 • 17 • 1

TheBloke/Synthia-MoE-v3-Mixtral-8x7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 16 • 10

HydraIndicLM/mistral-MoQlora-hindi-expert

Updated Dec 12, 2023 • 6 • 1

TheBloke/Terminis-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 18 • 1

TheBloke/pee-AWQ

Text Generation • Updated Dec 12, 2023 • 16

TheBloke/SeraphMarcoroni-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 15

TheBloke/Marcoroni-neural-chat-7B-v1-AWQ

Text Generation • Updated Dec 12, 2023 • 16 • 1

TheBloke/Pallas-0.4-GPTQ

Text Generation • Updated Dec 12, 2023 • 21 • 1

TheBloke/Pallas-0.4-AWQ

Text Generation • Updated Dec 12, 2023 • 16 • 1

TheBloke/mixtralnt-4x7b-test-GPTQ

Text Generation • Updated Dec 12, 2023 • 15 • 5

IndicRAGware/mistral-hindi-qlora-RAG-7b

Text Generation • Updated Dec 12, 2023 • 16