Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

239

Full-text search

Active filters: int8

Intel/t5-large-finetuned-xsum-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 7

Intel/t5-base-cnn-dm-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 5

Intel/bart-large-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 22, 2024 • 6 • 1

Intel/distilbart-cnn-12-6-int8-dynamic-inc

Text2Text Generation • Updated Mar 22, 2024 • 12 • 2

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 2

Intel/xlm-roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 2

Intel/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 5

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 4

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 19 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 12 • 9

DataAgent/llama-7b-alpaca-zh-20k

Updated Apr 8, 2023

ENOT-AutoDL/gpt-j-6B-tensorrt-int8

Text Generation • Updated Jun 8, 2023 • 7

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18, 2024 • 14

DataAgent/llama-7b-alpaca-zh-120k

Updated Apr 8, 2023 • 1

Intel/gpt-neox-japanese-2.7b-int8-inc

Text Generation • Updated Mar 21, 2024

michaelfeil/ct2fast-gpt-j-6b

Updated May 19, 2023 • 5 • 1

michaelfeil/ct2fast-pythia-12b

Updated May 21, 2023 • 2

michaelfeil/ct2fast-pythia-160m

Updated May 19, 2023 • 6 • 1

michaelfeil/ct2fast-gpt-neox-20b

Updated May 19, 2023 • 6

michaelfeil/ct2fast-Pythia-Chat-Base-7B

Updated May 21, 2023 • 5 • 1

michaelfeil/ct2fast-pythia-2.8b

Updated May 19, 2023 • 4 • 1

michaelfeil/ct2fast-pythia-6.9b

Updated May 19, 2023 • 4 • 1

michaelfeil/ct2fast-stablelm-7b-sft-v7-epoch-3

Text Generation • Updated Jun 2, 2023 • 11

michaelfeil/ct2fast-stablelm-tuned-alpha-7b

Updated May 22, 2023 • 2

michaelfeil/ct2fast-stablelm-base-alpha-3b

Updated May 22, 2023 • 4

michaelfeil/ct2fast-stablelm-tuned-alpha-3b

Updated May 22, 2023 • 7

michaelfeil/ct2fast-RedPajama-INCITE-Instruct-3B-v1

Updated May 19, 2023 • 5 • 3

michaelfeil/ct2fast-GPT-JT-6B-v0

Text Generation • Updated May 19, 2023 • 20 • 1

Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 9

Intel/whisper-large-int8-static-inc

Automatic Speech Recognition • Updated May 18, 2023 • 3