Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,191

Full-text search

Active filters: awq

TechxGenus/stable-code-3b-AWQ

Text Generation • Updated Apr 7, 2024 • 24 • 1

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Jul 5, 2024 • 3.06k • 35

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16, 2024 • 1.08k • 12

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19, 2024 • 5.95k • 68

TechxGenus/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • Updated Apr 19, 2024 • 1.33k • 5

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19, 2024 • 44 • 6

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3, 2024 • 25 • 4

solidrust/Poppy_Porpoise-v0.6-L3-8B-AWQ

Text Generation • Updated Sep 3, 2024 • 16 • 1

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated May 6, 2024 • 54 • 5

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23, 2024 • 1.88k • 7

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3, 2024 • 39 • 1

TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ

Text Generation • Updated Jun 22, 2024 • 70 • 7

palisaderesearch/Badllama-3-8B

Text Generation • Updated Nov 20, 2024 • 1

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27, 2024 • 40 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13, 2024 • 588 • 37

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 495k • 62

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 181k • 92

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 5.16k • 8

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated Jul 24, 2024 • 28 • 6

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated Oct 11, 2024 • 413 • 10

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25, 2024 • 432 • 4

iwaitu/llama-3.1-70b-chinese-chat-AWQ-4bit

Text Generation • Updated Aug 28, 2024 • 20 • 5

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29, 2024 • 80 • 3

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17, 2024 • 759 • 6

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 239k • 43

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 4.87k • 18

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29, 2024 • 133 • 1

VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct-awq

Updated Sep 1, 2024 • 65 • 1

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2, 2024 • 37 • 3

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9, 2024 • 200 • 6