Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

64

Full-text search

Active filters: microsoft

microsoft/Orca-2-7b

Text Generation • Updated Nov 22, 2023 • 5.9k • 216

microsoft/Orca-2-13b

Text Generation • Updated Nov 22, 2023 • 12.4k • 664

bartowski/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated Jun 6, 2024 • 567 • 6

unsloth/Phi-3.5-mini-instruct

Text Generation • Updated Nov 22, 2024 • 12.3k • 41

Badsims/sentis-phi-3.5-mini-instruct-uint8

Updated Sep 7, 2024 • 12 • 5

mradermacher/Orca-2-7b-i1-GGUF

Updated Nov 15, 2024 • 621 • 1

aegon-h/phi-1_5

Text Generation • Updated Sep 15, 2023 • 25 • 3

aegon-h/phi-base_model

Text Generation • Updated Sep 15, 2023 • 29

aegon-h/phi-1

Text Generation • Updated Sep 14, 2023 • 19

LoneStriker/Orca-2-13b-4.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 12 • 1

LoneStriker/Orca-2-13b-6.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 12

LoneStriker/Orca-2-13b-8.0bpw-h8-exl2

Text Generation • Updated Nov 21, 2023 • 12 • 3

LoneStriker/Orca-2-13b-3.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 12

LoneStriker/Orca-2-13b-5.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 16 • 1

LoneStriker/Orca-2-7b-4.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 12

LoneStriker/Orca-2-7b-6.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 13

LoneStriker/Orca-2-7b-8.0bpw-h8-exl2

Text Generation • Updated Nov 21, 2023 • 13

LoneStriker/Orca-2-7b-3.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 12

bartowski/Orca-2-7b-exl2

Text Generation • Updated Nov 21, 2023 • 2

LoneStriker/Orca-2-7b-5.0bpw-h6-exl2

Text Generation • Updated Nov 21, 2023 • 13

bartowski/Orca-2-13b-exl2

Text Generation • Updated Nov 21, 2023 • 3 • 1

second-state/Orca-2-13B-GGUF

Text Generation • Updated Mar 20, 2024 • 267 • 7

TheBloke/Orca-2-13B-GGUF

Text Generation • Updated Nov 21, 2023 • 1.83k • 62

TheBloke/Orca-2-13B-GPTQ

Text Generation • Updated Nov 21, 2023 • 35 • 27

TheBloke/Orca-2-7B-AWQ

Text Generation • Updated Nov 21, 2023 • 28 • 1

TheBloke/Orca-2-13B-AWQ

Text Generation • Updated Nov 21, 2023 • 29 • 7

TheBloke/Orca-2-7B-GGUF

Text Generation • Updated Nov 21, 2023 • 607 • 57

TheBloke/Orca-2-7B-GPTQ

Text Generation • Updated Nov 21, 2023 • 37 • 4

uukuguy/Orca-2-7b-f16

Text Generation • Updated Nov 25, 2023 • 855

uukuguy/Orca-2-13b-f16

Text Generation • Updated Nov 23, 2023 • 863