Quantized Llama 3.3 - a kaitchup Collection

kaitchup 's Collections

Quantized Falcon3

Quantized Llama 3.3

Quantized EuroLLM

Quantized Tulu 3 and OLMo 2

Quantized Qwen2.5

Opus Translation Datasets

GPTQ

Yi

Contaminated Mistral 7B and TinyLlama

Llama 3 70B ExLlamaV2 (bpw: 4.0, 3.5, 3.0, 2.5, and 2.18)

[Basics] Quantized Phi-3

[Basics] AutoRound: Llama 3

Quantized Llama 3.1

The Minitron Models and Their Teachers, Quantized

Minivoc

Quantized Llama 3.3

updated Dec 9, 2024

kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit

Text Generation • Updated Dec 9, 2024 • 6.32k • 6