Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

15,908

Full-text search

Active filters: bitsandbytes

prithivMLmods/QwQ-4B-Instruct

Text Generation • Updated 8 days ago • 315 • 11

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 369k • 48

thanhkt/codegemma-7B-ManimGen

Text Generation • Updated Oct 14, 2024 • 109 • 4

CaioXapelaum/Qwen-2.5-0.5B-Instruct-4bit

Text Generation • Updated 23 days ago • 100 • 2

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2, 2024 • 48 • 6

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9, 2024 • 536 • 8

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 581 • 10

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 1.64k • 8

ramy21/tinyllama2

Text Generation • Updated Dec 22, 2023 • 71 • 1

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 9.12k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16, 2024 • 56 • 12

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.95k • 9

ecastera/eva-mistral-catmacaroni-7b-spanish

Text Generation • Updated Jan 29, 2024 • 16 • 2

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 75 • 3

roshanrai1304/llama_2_finetune_on_real_estate_data

Text Generation • Updated Feb 1, 2024 • 179 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 510 • 24

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.27k • 19

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated 3 days ago • 44 • 5

NexaAIDev/Octopus-v1-gemma-7B

Text Generation • Updated Apr 3, 2024 • 22 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 341 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16, 2024 • 104 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 354 • 173

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21, 2024 • 8 • 1

ChaimaMess/llama-2-7b-squad

Text Generation • Updated Mar 25, 2024 • 46 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 234 • 248

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5, 2024 • 146 • 2

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 443 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10, 2024 • 157 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11, 2024 • 3 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 349k • 189