Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,191

Full-text search

Active filters: awq

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 24

SorawitChok/SeaLLM3-7B-Chat-AWQ

Text Generation • Updated Jul 16, 2024 • 217

aws-prototyping/MegaBeam-Mistral-7B-300k-AWQ

Text Generation • Updated Jul 16, 2024 • 27 • 1

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 25

PrunaAI/prometheus-eval-prometheus-7b-v2.0-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 103

huhuaixu/kdd_cup_24_track3

Text Generation • Updated Jul 16, 2024 • 22

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 22

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 26

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 24

DrSri/GLM-4-9b-Quantized-AWQ

Text Generation • Updated Jul 17, 2024 • 21 • 1

AnhQuangNguyen/new-function-calling

Text Generation • Updated Jul 16, 2024 • 23

PrunaAI/NexaAIDev-Octopus-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/stockmark-stockmark-13b-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 25

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 21

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 20

AnhQuangNguyen/Vistral-Chat-Function-Calling-AWQ

Text Generation • Updated Jul 16, 2024 • 21

lightontech/SeaLLM3-7B-Chat-AWQ

Text Generation • Updated Jul 17, 2024 • 29 • 1

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 22

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 25

PrunaAI/openchat-openchat-3.6-8b-20240522-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 26

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v1-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 22

PrunaAI/numind-NuExtract-tiny-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 27

Hariprasath28/SmolLM-1.7B-AWQ-4bit

Text Generation • Updated Jul 17, 2024 • 20

PrunaAI/abacusai-Llama-3-Smaug-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 24

Ksgk-fy/maria_v113_awq_zero_point

Text Generation • Updated Jul 17, 2024 • 23

chienweichang/Llama-3-Taiwan-8B-Instruct-AWQ

Text Generation • Updated Jul 17, 2024 • 22 • 1

PrunaAI/Weyaxi-Einstein-v7-Qwen2-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 27

aryamannningombam/llama-3-awq-4-bit

Text Generation • Updated Jul 17, 2024 • 23

PrunaAI/RLHFlow-pair-preference-model-LLaMA3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 24

hsan512/vistral_lora_merged_ver2-awq

Text Generation • Updated Jul 17, 2024 • 25