Edit Models filters

Model Tree

HuggingFaceTB/SmolLM2-135M-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

50

Full-text search

Active filters: HuggingFaceTB/SmolLM2-135M-Instruct

bartowski/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Oct 31, 2024 • 1.07k • 4

NikolayKozloff/SmolLM2-135M-Instruct-Q8_0-GGUF

Updated Oct 31, 2024 • 4 • 1

unsloth/SmolLM2-135M-Instruct-GGUF

Updated Oct 31, 2024 • 291 • 1

prithivMLmods/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 8, 2024 • 174 • 7

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3, 2024 • 242 • 1

QuantFactory/SmolLM2-Prompt-Enhance-GGUF

Text Generation • Updated Nov 7, 2024 • 431 • 2

mradermacher/SmolLM2-135M-Instruct-i1-GGUF

Updated Nov 26, 2024 • 280 • 1

HuggingFaceTB/SmolLM2-135M-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 42 • 2

Felladrin/gguf-Q8_0-SmolLM2-135M-Instruct

Updated Oct 31, 2024 • 4

Segilmez06/SmolLM2-135M-Instruct-Q4_K_M-GGUF

Updated Oct 31, 2024 • 5

Segilmez06/SmolLM2-135M-Instruct-Q2_K-GGUF

Updated Oct 31, 2024 • 3

Segilmez06/SmolLM2-135M-Instruct-Q8_0-GGUF

Updated Oct 31, 2024 • 2

lmstudio-community/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Oct 31, 2024 • 265

DevQuasar/HuggingFaceTB.SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 70

mlc-ai/SmolLM2-135M-Instruct-q4f32_1-MLC

Updated Nov 4, 2024 • 117

mlc-ai/SmolLM2-135M-Instruct-q0f32-MLC

Updated Nov 4, 2024 • 53

mlc-ai/SmolLM2-135M-Instruct-q4f16_1-MLC

Updated Nov 4, 2024 • 4

mlc-ai/SmolLM2-135M-Instruct-q0f16-MLC

Updated Nov 4, 2024 • 173

Triangle104/SmolLM2-135M-Instruct-Q4_K_S-GGUF

Updated Nov 7, 2024 • 7

Triangle104/SmolLM2-135M-Instruct-Q4_K_M-GGUF

Updated Nov 7, 2024 • 4

Triangle104/SmolLM2-135M-Instruct-Q5_K_S-GGUF

Updated Nov 7, 2024 • 8

Triangle104/SmolLM2-135M-Instruct-Q5_K_M-GGUF

Updated Nov 7, 2024 • 2

Triangle104/SmolLM2-135M-Instruct-Q6_K-GGUF

Updated Nov 7, 2024 • 5

Triangle104/SmolLM2-135M-Instruct-Q8_0-GGUF

Updated Nov 7, 2024 • 10

mav23/SmolLM2-Prompt-Enhance-GGUF

Text Generation • Updated Nov 8, 2024 • 44

mradermacher/SmolLM2-135M-Instruct-GGUF

Updated Nov 26, 2024 • 86

PrunaAI/HuggingFaceTB-SmolLM2-135M-Instruct-bnb-8bit-smashed

Updated Nov 21, 2024 • 4

Austinkeith2010/SmolLM2-135M-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 26, 2024 • 1

ngxson/SmolLM2-135M-Instruct-IQ4_XS-GGUF

Text Generation • Updated Nov 28, 2024 • 12

Austinkeith2010/SmolLM2-135M-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 30, 2024 • 2