Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

103,857

Full-text search

Active filters: conversational

lmstudio-community/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 12.4k • 6

bartowski/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 1.3k • 6

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 1.49k • 4

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 10.7k • 7

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 8.87k • 25

bartowski/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 5.99k • 7

lmstudio-community/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 589 • 2

mradermacher/MN-12B-Mag-Mell-R1-i1-GGUF

Updated Sep 18, 2024 • 1.92k • 7

Qwen/Qwen2-7B-Instruct-MLX

Text Generation • Updated Sep 18, 2024 • 230 • 2

TheSkullery/ED-Zephyria-48b

Text Generation • Updated Sep 18, 2024 • 35 • 1

TheSkullery/BA-Zephyria-39b

Text Generation • Updated Sep 18, 2024 • 59 • 2

mradermacher/llama-llava-medtrinity-GGUF

Updated Sep 18, 2024 • 49 • 2

Qwen/Qwen2.5-Coder-1.5B

Text Generation • Updated Nov 18, 2024 • 17.1k • 35

Qwen/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated Nov 18, 2024 • 13.7k • 51

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q4_K_S-GGUF

Updated Dec 1, 2024 • 10 • 1

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q4_K_M-GGUF

Updated Dec 1, 2024 • 19 • 1

SE6446/Llama-3.1-SuperNova-Lite-Reflection-V1.0

Text Generation • Updated Sep 20, 2024 • 27 • 2

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q5_K_M-GGUF

Updated Dec 1, 2024 • 12 • 1

cjvt/GaMS-1B-Chat

Text Generation • Updated Sep 27, 2024 • 136 • 2

openbmb/MiniCPM3-4B-GGUF

Updated Sep 18, 2024 • 1.93k • 6

AIDC-AI/Ovis1.6-Gemma2-9B

Image-Text-to-Text • Updated Nov 27, 2024 • 4.11k • 265

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q6_K-GGUF

Updated Dec 1, 2024 • 18 • 2

Casual-Autopsy/L3-Luna-8B-iMat-GGUF

Updated Sep 18, 2024 • 18 • 2

rasa/cmd_gen_llama_3.1_8b_calm_demo

Text Generation • Updated Sep 26, 2024 • 22 • 2

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 5.59k • 17

bartowski/Cydonia-22B-v1-GGUF

Text Generation • Updated Sep 18, 2024 • 750 • 12

tangledgroup/tangled-llama-33m-32k-base-v0.1

Text Generation • Updated Oct 2, 2024 • 37 • 1

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-GGUF

Updated Sep 18, 2024 • 24 • 2

THUdyh/Oryx-7B

Text Generation • Updated Sep 25, 2024 • 165 • 11

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 851 • 2