Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

8-bit precision

4-bit precision

text-generation-inference

Carbon Emissions

text-embeddings-inference

Misc with no match

Mixture of Experts

Models

125

Full-text search

Active filters: nncf

anokimchen/sd-turbo-openvino-8bit-no-calibration

Text-to-Image • Updated Aug 7, 2024 • 1

anokimchen/sd-turbo-openvino-8bit-GPT4vision-calibrated

Text-to-Image • Updated Aug 7, 2024 • 1

NikolayKozloff/MKLLM-7B-Instruct-openvino-4bit

Updated Nov 7, 2024 • 14 • 1

NikolayKozloff/MKLLM-7B-Instruct-openvino-8bit

Updated Nov 8, 2024 • 11 • 1

AIFunOver/all-MiniLM-L6-v2-openvino-8bit

Sentence Similarity • Updated Nov 11, 2024 • 17 • 1

marquesafonso/NuExtract-openvino-8bit

Updated Dec 2, 2024 • 6 • 1

AIFunOver/DRT-o1-7B-openvino-8bit

Text Generation • Updated 9 days ago • 9 • 1

echarlaix/distilgpt2-openvino-4bit

Text Generation • Updated 22 days ago • 75

echarlaix/distilbert-base-uncased-distilled-squad-openvino-8bit

Question Answering • Updated Jul 31, 2024 • 5

emmacall/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Aug 15, 2024 • 10

riacheruvu/Qwen2-7B-Instruct-openvino-4bit

Text Generation • Updated Aug 8, 2024 • 12

riacheruvu/Qwen2-7B-Instruct-openvino-8bit

Text Generation • Updated Aug 8, 2024 • 9

fiorezhang/Qwen2-7B-Instruct-openvino-4bit

Text Generation • Updated Aug 14, 2024 • 17

malcolmchan/Phi-3-mini-4k-instruct-openvino-8bit

Text Generation • Updated Aug 14, 2024 • 20

emmacall/Phi-3-medium-4k-instruct-openvino-4bit

Text Generation • Updated Aug 15, 2024 • 10

elucidator8918/Lynx-8B-Instruct-4bit

Text Generation • Updated Aug 16, 2024 • 119

AlexKoff88/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Sep 3, 2024 • 15

AlexKoff88/Phi-3-mini-4k-instruct-openvino-8bit

Text Generation • Updated Sep 3, 2024 • 13

yujiepan/llama-2-tiny-3layers-random-openvino-8bit

Text Generation • Updated Sep 4, 2024 • 8

yujiepan/mixtral-8xtiny-random-openvino-8bit

Text Generation • Updated Sep 4, 2024 • 7

FM-1976/stablelm-zephyr-3b-openvino-4bit

Updated Oct 6, 2024 • 17

riacheruvu/phi-2-openvino-8bit

Text Generation • Updated Oct 7, 2024 • 22

chgk13/Qwen2-0.5B-openvino-8bit

Text Generation • Updated Oct 14, 2024 • 11

AlexKoff88/TinyLlama-1.1B-Chat-v1.0-openvino-4bit

Updated Oct 17, 2024 • 4

AlexKoff88/opt-125m-openvino-4bit

Text Generation • Updated Oct 17, 2024 • 10

AlexKoff88/Phi-3.5-mini-instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 15

AlexKoff88/Phi-3.5-mini-instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 13

AlexKoff88/Phi-3.5-mini-instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 6

AIFunOver/Phi-3.5-mini-instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 16

AIFunOver/Phi-3.5-mini-instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 13