Edit Models filters

Inference status

Misc

arxiv: 2310.08659

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

25

Full-text search

Active filters: 2310.08659

LoftQ/Llama-2-7b-hf-4bit-64rank

Text Generation • Updated May 3, 2024 • 81 • 1

LoftQ/Llama-2-13b-hf-4bit-64rank

Text Generation • Updated Dec 19, 2023 • 97 • 2

LoftQ/Llama-2-70b-hf-4bit-64rank

Text Generation • Updated May 3, 2024 • 22 • 1

LoftQ/Mistral-7B-v0.1-4bit-32rank

Text Generation • Updated Dec 20, 2023 • 22

LoftQ/Mistral-7B-v0.1-4bit-64rank

Text Generation • Updated Apr 18, 2024 • 50 • 2

LoftQ/Llama-2-7b-hf-fp16-64rank-gsm8k

Updated Dec 20, 2023 • 6

LoftQ/phi-2-4bit-64rank

Text Generation • Updated Aug 15, 2024 • 22

LoftQ/Meta-Llama-3-8B-4bit-64rank

Text Generation • Updated May 3, 2024 • 1.99k • 1

LoftQ/CodeLlama-7b-hf-4bit-64rank

Text Generation • Updated Apr 20, 2024 • 16

LoftQ/CodeLlama-13b-hf-4bit-64rank

Text Generation • Updated Apr 20, 2024 • 13

LoftQ/Meta-Llama-3-8B-Instruct-4bit-64rank

Text Generation • Updated May 3, 2024 • 83 • 1

LoftQ/Meta-Llama-3-70B-4bit-64rank-1iter

Text Generation • Updated Apr 21, 2024 • 13 • 2

LoftQ/Meta-Llama-3-70B-4bit-64rank

Text Generation • Updated May 3, 2024 • 18 • 1

LoftQ/Meta-Llama-3-70B-Instruct-4bit-64rank

Text Generation • Updated May 3, 2024 • 20 • 1

LoftQ/Phi-3-mini-128k-instruct-4bit-64rank

Text Generation • Updated May 3, 2024 • 25

LoftQ/Phi-3-mini-4k-instruct-4bit-64rank

Text Generation • Updated May 3, 2024 • 26

anamikac2708/Llama3-8b-LoftQ-finetuned-investopedia-Lora-Adapters

Updated Jun 18, 2024

RichardErkhov/LoftQ_-_Llama-2-13b-hf-4bit-64rank-gguf

Updated Aug 12, 2024 • 16

RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-gguf

Updated Aug 18, 2024 • 2

RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-4bits

Updated Oct 18, 2024 • 2

RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-8bits

Updated Oct 18, 2024 • 2

RichardErkhov/LoftQ_-_Llama-2-13b-hf-4bit-64rank-4bits

Updated Oct 26, 2024 • 2

RichardErkhov/LoftQ_-_phi-2-4bit-64rank-gguf

Updated Oct 30, 2024 • 34

RichardErkhov/LoftQ_-_phi-2-4bit-64rank-4bits

Updated Oct 30, 2024 • 2

RichardErkhov/LoftQ_-_phi-2-4bit-64rank-8bits

Updated Oct 30, 2024 • 2