Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

504

Full-text search

Active filters: pretrained

ProCreations/Qwen1.5-0.5B-Q4_K_M-GGUF

Text Generation • Updated Mar 29, 2024

ProCreations/Qwen1.5-4B-Q5_0-GGUF

Text Generation • Updated Mar 29, 2024

mlx-community/Qwen1.5-MoE-A2.7B-4bit

Text Generation • Updated Apr 2, 2024 • 8

Qwen/Qwen1.5-32B

Text Generation • Updated Apr 5, 2024 • 17.9k • 83

mlx-community/Qwen1.5-MoE-A2.7B-Chat-4bit

Text Generation • Updated Apr 2, 2024 • 13 • 5

jesusoctavioas/wikisql-4bit-1k

Text Generation • Updated Apr 3, 2024 • 5

Tweeties/tweety-7b-italian-v24a

Text Generation • Updated May 13, 2024 • 11 • 2

MarsupialAI/Qwen1.5-32B_iMatrix_GGUF

Text Generation • Updated May 11, 2024 • 14 • 1

mlx-community/Qwen1.5-32B-4bit

Text Generation • Updated Apr 5, 2024 • 13 • 1

mlx-community/Qwen1.5-32B-8bit

Text Generation • Updated Apr 5, 2024 • 5

LoneStriker/Qwen1.5-32B-3.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 5

LoneStriker/Qwen1.5-32B-4.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 5

LoneStriker/Qwen1.5-32B-4.65bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 5

LoneStriker/Qwen1.5-32B-5.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 11

LoneStriker/Qwen1.5-32B-6.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 7

LoneStriker/Qwen1.5-32B-8.0bpw-h8-exl2

Text Generation • Updated Apr 6, 2024 • 6

teneriffa/Qwen1.5-32B-Q4_0-GGUF

Text Generation • Updated Apr 6, 2024 • 5

OpenLLM-France/Claire-7B-EN-0.1

Text Generation • Updated Sep 4, 2024 • 8 • 1

mlx-community/Qwen1.5-0.5B-4bit

Text Generation • Updated Apr 8, 2024 • 5

CryogenicPlanet/mistral-jax

Text Generation • Updated Apr 9, 2024

dicta-il/dictalm2.0

Text Generation • Updated Jul 10, 2024 • 10.6k • 11

pere/mistral-maxtext-export-test

Text Generation • Updated Apr 12, 2024 • 4

jeremy02au/Qwen1.5-1.8B-GPTQ

Text Generation • Updated Apr 11, 2024 • 7

dicta-il/dictalm2.0-AWQ

Text Generation • Updated Jul 10, 2024 • 334

dicta-il/dictalm2.0-GPTQ

Text Generation • Updated Jul 10, 2024 • 77

mlx-community/Qwen1.5-72B-4bit

Text Generation • Updated Apr 13, 2024 • 4

RaphaelMourad/Mistral-DNA-v1-138M-bacteria

Text Generation • Updated Aug 4, 2024 • 97 • 3

DavidAU/roleplay-model-v2-Q6_K-GGUF

Updated Apr 16, 2024 • 31

NikolayKozloff/tweety-7b-italian-GGUF

Text Generation • Updated Apr 16, 2024 • 13 • 1

NikolayKozloff/CodeQwen1.5-7B-Q8_0-GGUF

Text Generation • Updated Apr 16, 2024 • 1 • 4