Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

83

Full-text search

Active filters: 7-bit

Dracones/Merged-RP-Stew-V2-34B_exl2_7.0bpw

Text Generation • Updated Apr 11, 2024 • 6

Dracones/c4ai-command-r-v01_exl2_7.0bpw

Text Generation • Updated Apr 12, 2024 • 5

Dracones/c4ai-command-r-v01_exl2_7.0bpw-rpcal

Text Generation • Updated Apr 12, 2024 • 9

Dracones/miqu-1-70b-sf_exl2_7.0bpw

Text Generation • Updated Apr 11, 2024 • 5

Dracones/c4ai-command-r-plus_exl2_7.0bpw

Text Generation • Updated Apr 13, 2024 • 7

Dracones/mixtral-8x22b-instruct-oh_exl2_7.0bpw

Text Generation • Updated Apr 14, 2024 • 6

bdambrosio/dbrx-instruct-7.0bpw-h8-exl2

Text Generation • Updated Apr 15, 2024 • 8

Dracones/WizardLM-2-8x22B_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 9

Dracones/CodeQwen1.5-7B-Chat_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 5

Dracones/CodeQwen1.5-7B_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 4

Dracones/Llama-3-Lumimaid-70B-v0.1_exl2_7.0bpw

Text Generation • Updated May 4, 2024 • 14

FuturisticVibes/Coomand-R-35B-v1-7.0bpw-h8-exl2

Text Generation • Updated May 12, 2024 • 15

FuturisticVibes/L3-Arcania-4x8b-7.0bpw-h8-exl2

Text Generation • Updated May 14, 2024 • 17

SicariusSicariiStuff/CalderaAI_Foredoomed-9B_EXL-7.0

Text Generation • Updated May 18, 2024 • 19 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.0bpw

Text Generation • Updated Jun 6, 2024 • 19

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_7.0bpw_h8

Text Generation • Updated Jun 19, 2024 • 17

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_7.0bpw

Text Generation • Updated Jun 23, 2024 • 18

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_7.0bpw

Text Generation • Updated Jun 23, 2024 • 15

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8

Text Generation • Updated Jun 25, 2024 • 17

BigHuggyD/alpindale_magnum-72b-v1_exl2_7.0bpw_h8

Text Generation • Updated Jun 26, 2024 • 16

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_7.0bpw_h8

Text Generation • Updated Jun 28, 2024 • 22

bigstorm/Hermes-2-Theta-Llama-3-70B-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 17

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 22

bigstorm/firefunction-v2-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 21

bigstorm/Llama-3-Groq-70B-Tool-Use-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 6

DrNicefellow/Mistral-Nemo-Instruct-2407-exl2-7bpw-h8

Text Generation • Updated Jul 18, 2024 • 7

bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 24, 2024 • 5

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 11

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_7.0bpw_h8

Text Generation • Updated Jul 30, 2024 • 5

SicariusSicariiStuff/2B_or_not_2B-EXL2-7.0bpw

Updated Aug 11, 2024 • 2