Edit Models filters

Model Tree

HuggingFaceTB/SmolLM2-135M-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

50

Full-text search

Active filters: HuggingFaceTB/SmolLM2-135M-Instruct

bartowski/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Oct 31, 2024 • 1.08k • 4

NikolayKozloff/SmolLM2-135M-Instruct-Q8_0-GGUF

Updated Oct 31, 2024 • 4 • 1

unsloth/SmolLM2-135M-Instruct-GGUF

Updated Oct 31, 2024 • 279 • 1

prithivMLmods/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 8, 2024 • 180 • 7

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3, 2024 • 355 • 1

QuantFactory/SmolLM2-Prompt-Enhance-GGUF

Text Generation • Updated Nov 7, 2024 • 528 • 2

mradermacher/SmolLM2-135M-Instruct-i1-GGUF

Updated Nov 26, 2024 • 258 • 1

HuggingFaceTB/SmolLM2-135M-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 33 • 1

Felladrin/gguf-Q8_0-SmolLM2-135M-Instruct

Updated Oct 31, 2024 • 12

Segilmez06/SmolLM2-135M-Instruct-Q4_K_M-GGUF

Updated Oct 31, 2024 • 5

Segilmez06/SmolLM2-135M-Instruct-Q2_K-GGUF

Updated Oct 31, 2024 • 3

Segilmez06/SmolLM2-135M-Instruct-Q8_0-GGUF

Updated Oct 31, 2024 • 2

lmstudio-community/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Oct 31, 2024 • 277

DevQuasar/HuggingFaceTB.SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 76

mlc-ai/SmolLM2-135M-Instruct-q4f32_1-MLC

Updated Nov 4, 2024 • 112

mlc-ai/SmolLM2-135M-Instruct-q0f32-MLC

Updated Nov 4, 2024 • 52

mlc-ai/SmolLM2-135M-Instruct-q4f16_1-MLC

Updated Nov 4, 2024 • 4

mlc-ai/SmolLM2-135M-Instruct-q0f16-MLC

Updated Nov 4, 2024 • 187

Triangle104/SmolLM2-135M-Instruct-Q4_K_S-GGUF

Updated Nov 7, 2024 • 7

Triangle104/SmolLM2-135M-Instruct-Q4_K_M-GGUF

Updated Nov 7, 2024 • 5

Triangle104/SmolLM2-135M-Instruct-Q5_K_S-GGUF

Updated Nov 7, 2024 • 8

Triangle104/SmolLM2-135M-Instruct-Q5_K_M-GGUF

Updated Nov 7, 2024 • 3

Triangle104/SmolLM2-135M-Instruct-Q6_K-GGUF

Updated Nov 7, 2024 • 6

Triangle104/SmolLM2-135M-Instruct-Q8_0-GGUF

Updated Nov 7, 2024 • 12

mav23/SmolLM2-Prompt-Enhance-GGUF

Text Generation • Updated Nov 8, 2024 • 42

mradermacher/SmolLM2-135M-Instruct-GGUF

Updated Nov 26, 2024 • 89

PrunaAI/HuggingFaceTB-SmolLM2-135M-Instruct-bnb-8bit-smashed

Updated Nov 21, 2024 • 6

Austinkeith2010/SmolLM2-135M-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 26, 2024 • 1

ngxson/SmolLM2-135M-Instruct-IQ4_XS-GGUF

Text Generation • Updated Nov 28, 2024 • 11

Austinkeith2010/SmolLM2-135M-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 30, 2024 • 2