File size: 390 Bytes
362d372 dd1a343 362d372 dd1a343 a29e824 dd1a343 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
license: llama3.1
tags:
- gguf
- llama3
- llama
pipeline_tag: text-generation
---
# Meta-Llama-3.1-405B-Instruct-GGUF
Low bit quantizations of Meta's Llama 3.1 405B Instruct model. Quantized from ollama q4_0 GGUF.
**Quants:**
- Q2_K
- (imatrix)
- Q3_K_M
- Q3_K_S
- Q3_K_L
- Q4_K_M
- Q4_0
- Q4_K_S
## imatrix
Generated from Q2_K quant.
imatrix calibration data: `groups_merged.txt` |