Edit Models filters

Inference status

Misc

neural-compressor

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

48

Full-text search

Active filters: neural-compressor

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 69 • 5

Intel/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 16

Intel/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 18

Intel/camembert-base-mrpc-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 19

Intel/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 20

Intel/xlnet-base-cased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 14

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 18

Intel/bert-base-uncased-squad-int8-static-inc

Question Answering • Updated Oct 6, 2023 • 5 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 2.16k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 26 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 2.22k • 4

Intel/roberta-large-mnli-int8-static-inc

Text Classification • Updated Oct 6, 2023 • 16

Intel/t5-small-xsum-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 2.12k • 1

Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc

Text2Text Generation • Updated Oct 6, 2023 • 23

Intel/t5-large-finetuned-xsum-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 21

Intel/t5-base-cnn-dm-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 18

Intel/bart-large-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 22, 2024 • 21 • 1

Intel/distilbart-cnn-12-6-int8-dynamic-inc

Text2Text Generation • Updated Mar 22, 2024 • 12 • 2

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 14 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 14 • 9

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18, 2024 • 22

Intel/gpt-neox-japanese-2.7b-int8-inc

Text Generation • Updated Mar 21, 2024

Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 15

Intel/whisper-large-int8-static-inc

Automatic Speech Recognition • Updated May 18, 2023 • 10

Intel/whisper-large-int8-dynamic-inc

Automatic Speech Recognition • Updated May 18, 2023 • 12 • 1

Intel/bert-large-uncased-rte-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 16

Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 17 • 1

Intel/distilbert-base-uncased-MRPC-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 17

Intel/albert-base-v2-MRPC-int8-inc

Text Classification • Updated Mar 22, 2024 • 12

Intel/deberta-v3-base-mrpc-int8-static-inc

Text Classification • Updated May 25, 2023 • 17