leafspark
/

Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-GGUF

1 contributor

History: 24 commits

leafspark's picture

Upload Llama-3.1-405B-Instruct.Q4_0.gguf/Llama-3.1-405B-Instruct.Q4_0-00003-of-00012.gguf with huggingface_hub

306944d verified 6 months ago

Llama-3.1-405B-Instruct.Q2_K.gguf
Upload Llama-3.1-405B-Instruct.Q2_K.gguf/Llama-3.1-405B-Instruct.Q2_K-00008-of-00008.gguf with huggingface_hub 6 months ago
Llama-3.1-405B-Instruct.Q4_0.gguf
Upload Llama-3.1-405B-Instruct.Q4_0.gguf/Llama-3.1-405B-Instruct.Q4_0-00003-of-00012.gguf with huggingface_hub 6 months ago
.gitattributes

2.9 kB

Upload Llama-3.1-405B-Instruct.Q4_0.gguf/Llama-3.1-405B-Instruct.Q4_0-00003-of-00012.gguf with huggingface_hub 6 months ago
README.md

1.82 kB

readme: add information about tokenizer 6 months ago
imatrix.dat.at_3

76.4 MB
LFS

model: add chunk 3 imatrix 6 months ago