Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,866

Full-text search

Active filters: quantized

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated Nov 13, 2024 • 80.1k • 100

afrideva/malaysian-tinyllama-1.1b-16k-instructions-GGUF

Text Generation • Updated Nov 12, 2023 • 23 • 2

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 65 • 3

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 9.47k • 3

afrideva/zephyr-smol_llama-100m-sft-full-GGUF

Text Generation • Updated Nov 28, 2023 • 1.43k • 3

afrideva/malaysian-mistral-1.1B-4096-GGUF

Text Generation • Updated Nov 29, 2023 • 233 • 2

afrideva/tiny-llama-1.1b-chat-medical-GGUF

Text Generation • Updated Dec 1, 2023 • 82 • 5

afrideva/minima-3b-layla-v2-GGUF

Text Generation • Updated Dec 19, 2023 • 41 • 4

MaziyarPanahi/MetaMath-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 132 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 451 • 49

MaziyarPanahi/BioMistral-7B-SLERP-GGUF

Text Generation • Updated Feb 19, 2024 • 115 • 4

Lewdiculous/Kunocchini-7b-128k-test-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 457 • 29

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30, 2024 • 23

qualcomm/Baichuan-7B

Text Generation • Updated Oct 10, 2024 • 8

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 3.88k • 36

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27, 2024 • 136 • 14

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated 17 days ago • 63

MaziyarPanahi/34b-beta-GGUF

Text Generation • Updated Mar 4, 2024 • 121 • 4

Lewdiculous/Layris_9B-GGUF-IQ-Imatrix

Text Generation • Updated May 4, 2024 • 313 • 18

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4, 2024 • 371 • 26

Lewdiculous/InfinityNexus_9B-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 80 • 5

Lewdiculous/Model-Requests

Updated Sep 9, 2024 • 39

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • Updated Mar 18, 2024 • 152 • 6

Lewdiculous/RP_Vision_7B-GGUF-IQ-Imatrix

Updated Mar 23, 2024 • 459 • 6

ilsp/Meltemi-7B-Instruct-v1-AWQ

Text Generation • Updated Apr 8, 2024 • 160 • 6

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Jul 5, 2024 • 3.09k • 35

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4, 2024 • 1.61k • 47

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 2.36M • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 30.7k • 125

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16, 2024 • 1.03k • 12