Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

15,755

Full-text search

Active filters: bitsandbytes

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 385k • 48

prithivMLmods/QwQ-4B-Instruct

Text Generation • Updated 6 days ago • 296 • 11

thanhkt/codegemma-7B-ManimGen

Text Generation • Updated Oct 14, 2024 • 27 • 4

CaioXapelaum/Qwen-2.5-0.5B-Instruct-4bit

Text Generation • Updated 20 days ago • 85 • 2

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2, 2024 • 50 • 6

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9, 2024 • 529 • 8

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 596 • 10

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 1.69k • 8

ramy21/tinyllama2

Text Generation • Updated Dec 22, 2023 • 75 • 1

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 9.83k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16, 2024 • 53 • 12

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.85k • 9

ecastera/eva-mistral-catmacaroni-7b-spanish

Text Generation • Updated Jan 29, 2024 • 18 • 2

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 72 • 3

roshanrai1304/llama_2_finetune_on_real_estate_data

Text Generation • Updated Feb 1, 2024 • 195 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 459 • 23

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.32k • 19

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated about 18 hours ago • 48 • 5

NexaAIDev/Octopus-v1-gemma-7B

Text Generation • Updated Apr 3, 2024 • 22 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 283 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16, 2024 • 105 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 349 • 173

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21, 2024 • 9 • 1

ChaimaMess/llama-2-7b-squad

Text Generation • Updated Mar 25, 2024 • 35 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 240 • 248

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5, 2024 • 142 • 2

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 323 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10, 2024 • 140 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11, 2024 • 3 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 322k • 189