Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Misc with no match

Carbon Emissions

Mixture of Experts

Models

236

Full-text search

Active filters: granite

ibm/PowerLM-3b

Text Generation • Updated Sep 16, 2024 • 9.64k • 18

mradermacher/granite-20b-code-base-GGUF

Updated Dec 16, 2024 • 24

mradermacher/granite-20b-code-base-i1-GGUF

Updated Dec 16, 2024 • 38 • 1

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • Updated Sep 1, 2024 • 250

mradermacher/granite-3b-code-base-128k-GGUF

Updated Sep 4, 2024 • 25 • 1

mradermacher/granite-3b-code-base-2k-GGUF

Updated Sep 3, 2024 • 2

mradermacher/granite-3b-code-instruct-2k-GGUF

Updated Sep 4, 2024 • 11

mradermacher/granite-3b-code-base-2k-i1-GGUF

Updated Sep 3, 2024 • 52

mradermacher/granite-8b-code-base-128k-GGUF

Updated Sep 3, 2024 • 29 • 1

mradermacher/granite-8b-code-base-128k-i1-GGUF

Updated Sep 4, 2024 • 150 • 1

mradermacher/granite-8b-code-base-4k-GGUF

Updated Sep 4, 2024

mradermacher/granite-8b-code-instruct-4k-GGUF

Updated Sep 4, 2024 • 64

mradermacher/granite-20b-code-base-8k-GGUF

Updated Sep 4, 2024

mradermacher/granite-20b-code-instruct-8k-GGUF

Updated Sep 3, 2024 • 172

mradermacher/granite-20b-code-instruct-8k-i1-GGUF

Updated Sep 6, 2024 • 63

mradermacher/granite-34b-code-base-8k-GGUF

Updated Sep 4, 2024 • 66

mradermacher/granite-3b-code-base-128k-i1-GGUF

Updated Sep 4, 2024 • 16

mradermacher/granite-8b-code-instruct-4k-i1-GGUF

Updated Sep 4, 2024 • 38

mradermacher/granite-3b-code-instruct-2k-i1-GGUF

Updated Sep 4, 2024 • 7

mradermacher/granite-20b-code-base-8k-i1-GGUF

Updated Sep 4, 2024 • 61

mradermacher/granite-8b-code-base-4k-i1-GGUF

Updated Sep 5, 2024 • 36

mradermacher/granite-34b-code-base-8k-i1-GGUF

Updated Sep 4, 2024 • 8

QuantFactory/granite-7b-instruct-GGUF

Text Generation • Updated Sep 5, 2024 • 80 • 2

royleibov/granite-7b-instruct-ZipNN-Compressed

Text Generation • Updated Sep 15, 2024 • 66 • 2

QuantFactory/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 7, 2024 • 96 • 2

QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 91 • 2

QuantFactory/granite-8b-code-instruct-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 167 • 3

QuantFactory/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 7, 2024 • 175 • 2

mradermacher/granite-34b-code-instruct-8k-GGUF

Updated Sep 9, 2024 • 433 • 1

mradermacher/granite-34b-code-instruct-8k-i1-GGUF

Updated Sep 9, 2024 • 81