Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

Misc with no match

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

80

Full-text search

Active filters: granite-3.0

mav23/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Nov 7, 2024 • 123

mav23/granite-3.0-8b-base-GGUF

Text Generation • Updated Nov 9, 2024 • 62

tensorblock/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Nov 16, 2024 • 50

anime-sssh/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 14, 2024 • 2

mradermacher/granite-3.0-8b-instruct-GGUF

Updated Nov 16, 2024 • 65

mradermacher/granite-3.0-8b-instruct-i1-GGUF

Updated Nov 16, 2024 • 45

mradermacher/granite-3.0-3b-a800m-instruct-GGUF

Updated Nov 17, 2024 • 21

mradermacher/granite-3.0-1b-a400m-instruct-GGUF

Updated Nov 16, 2024 • 187

mradermacher/granite-3.0-1b-a400m-instruct-i1-GGUF

Updated Nov 16, 2024 • 383

mradermacher/granite-3.0-2b-instruct-GGUF

Updated Nov 20, 2024 • 148

mradermacher/granite-3.0-2b-instruct-i1-GGUF

Updated Nov 20, 2024 • 238

jayakody2000lk/granite-3.0-8b-instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 21, 2024 • 3

tensorblock/granite-3.0-2b-base-GGUF

Text Generation • Updated Nov 25, 2024 • 31 • 1

tensorblock/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Nov 25, 2024 • 73

tensorblock/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 40

tensorblock/granite-3.0-1b-a400m-base-GGUF

Text Generation • Updated Nov 26, 2024 • 49

tensorblock/granite-3.0-3b-a800m-base-GGUF

Text Generation • Updated Nov 26, 2024 • 48 • 1

tensorblock/granite-3.0-8b-base-GGUF

Text Generation • Updated Nov 27, 2024 • 19

itlwas/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated 16 days ago • 35

itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • Updated 16 days ago • 34