Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,064

Full-text search

Active filters: GGUF

andrijdavid/finance-chat-GGUF

Text Generation • Updated Jan 19, 2024 • 97 • 1

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • Updated Jan 2, 2024 • 65

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • Updated Jan 2, 2024 • 18

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • Updated Jan 2, 2024 • 13

Trelis/Tiny

Text Generation • Updated Feb 22, 2024 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

Updated Jan 4, 2024 • 40

rabil/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 4, 2024 • 31

tsunemoto/Norobara-ZLoss-8x7B-GGUF

Updated Jan 5, 2024 • 16

rabil/deepseek-coder-6.7b-instruct-llamafile

Updated Jan 5, 2024 • 24 • 2

rabil/dolphin-2_6-phi-2-llamafile

Updated Jan 7, 2024 • 28

tsunemoto/LiteLlama-460M-1T-GGUF

Updated Jan 7, 2024 • 78 • 6

rabil/openchat-3.5-0106-llamafile

Updated Jan 11, 2024 • 23

tuantran1632001/Psyfighter2-Orca2-13B-ties-GGUF

Updated Jan 12, 2024 • 140

sethuiyer/MedleyMD-GGUF

Updated Jan 15, 2024 • 7 • 1

tsunemoto/NexoNimbus-7B-GGUF

Updated Jan 15, 2024 • 15 • 1

tsunemoto/Heimer-kto-TinyLlama-1.1B-GGUF

Updated Jan 15, 2024 • 13

tsunemoto/Heimer-ipo-TinyLlama-1.1B-GGUF

Updated Jan 15, 2024 • 9

tsunemoto/Heimer-dpo-TinyLlama-1.1B-GGUF

Updated Jan 15, 2024 • 4

vicgalle/solarized-18B-dpo-GGUF

Updated Jan 20, 2024 • 49 • 3

andrijdavid/baby-llama-58m-GGUF

Text Generation • Updated Jan 19, 2024 • 8

andrijdavid/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • Updated Jan 19, 2024 • 95

vicgalle/solarized-13B-dpo-GGUF

Updated Jan 20, 2024 • 9 • 2

vicgalle/NeuralBeagle-11B-GGUF

Updated Jan 20, 2024 • 5 • 4

tsunemoto/TinyDolphin-2.8-1.1b-GGUF

Updated Jan 22, 2024 • 189 • 7

refarde/Mistral-7B-Instruct-v0.2-Ko-S-Core-GGUF

Text Generation • Updated Jan 23, 2024 • 28 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • Updated Jan 26, 2024 • 205 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 84 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26, 2024 • 112 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Jan 30, 2024 • 84 • 5

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 98 • 3