Edit Models filters

Inference status

Misc

intel/auto-round

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

115

Full-text search

Active filters: intel/auto-round

fbaldassarri/meta-llama_Llama-3.2-1B-auto_round-int4-gs128-asym

Text Generation • Updated Dec 2, 2024 • 235

fbaldassarri/meta-llama_Llama-3.2-1B-auto_round-int4-gs128-sym

Text Generation • Updated Dec 2, 2024 • 33

OPEA/glm-4-9b-chat-int4-sym-lm-head-inc

Updated 15 days ago • 5

OPEA/internlm2_5-7b-chat-int4-sym-inc

Updated 15 days ago • 2

OPEA/Marco-o1-int4-sym-inc

Updated 15 days ago • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs128-asym

Text Generation • Updated Dec 4, 2024 • 9

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs128-sym

Text Generation • Updated Dec 4, 2024 • 11

OPEA/Phi-3.5-vision-instruct-qvision-int4-sym-inc

Updated 14 days ago • 15 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-qvision-int4-sym-inc

Updated 14 days ago • 119

OPEA/DeepSeek-V2-Lite-int4-sym-inc

Updated 15 days ago • 17

OPEA/glm-4v-9b-int4-sym-inc

Updated 15 days ago • 22

fbaldassarri/meta-llama_Llama-3.1-8B-auto_round-int4-gs128-asym

Text Generation • Updated Dec 5, 2024 • 11

fbaldassarri/meta-llama_Llama-3.1-8B-auto_round-int4-gs128-sym

Text Generation • Updated Dec 5, 2024 • 9

OPEA/OLMo-2-1124-13B-Instruct-int4-sym-inc

Updated 15 days ago • 9

OPEA/OLMo-2-1124-7B-Instruct-int4-sym-inc

Updated 15 days ago • 7

OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc

Updated 16 days ago • 16

fbaldassarri/EleutherAI_pythia-6.9b-deduped-autoround-int4-gs128-asym

Text Generation • Updated Dec 7, 2024 • 9

fbaldassarri/EleutherAI_pythia-6.9b-deduped-autoround-int4-gs128-sym

Text Generation • Updated Dec 7, 2024 • 8

OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc

Updated 3 days ago • 234 • 1

OPEA/Llama-3.3-70B-Instruct-int4-sym-inc

Updated 16 days ago • 36

OPEA/Qwen2-VL-72B-Instruct-int4-sym-inc

Updated 16 days ago • 21

fbaldassarri/allenai_OLMo-2-1124-7B-autoround-int4-gs128-asym

Text Generation • Updated 26 days ago • 5

fbaldassarri/allenai_OLMo-2-1124-7B-autoround-int4-gs128-sym

Text Generation • Updated 26 days ago • 8

OPEA/Falcon3-3B-Base-int4-sym-inc

Updated 16 days ago • 30

OPEA/Falcon3-7B-Base-int4-sym-inc

Updated 15 days ago • 11

OPEA/Falcon3-10B-Base-int4-sym-inc

Updated 15 days ago • 45

OPEA/Llama-3.3-70B-Instruct-int2-sym-inc-preview

Updated 16 days ago • 8

OPEA/Qwen2.5-72B-Instruct-int2-sym-inc

Updated 14 days ago • 18

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-auto_round-int4-gs128-asym

Text Generation • Updated 3 days ago • 22

fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_round-int4-gs128-asym

Text Generation • Updated 3 days ago • 21