mmnga
/

Llama-3.1-Nemotron-70B-Instruct-HF-gguf

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-Nemotron-70B-Instruct-HF-gguf

1 contributor

History: 11 commits

mmnga's picture

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_S.gguf with huggingface_hub

0040b4c verified about 2 months ago

.gitattributes

2.19 kB

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_S.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_S.gguf

22.2 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_S.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XS.gguf

21.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XS.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XXS.gguf

19.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ2_XXS.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ4_NL.gguf

40.1 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ4_NL.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-IQ4_XS.gguf

37.9 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-IQ4_XS.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M.gguf

42.5 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M.gguf with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M.gguf.a

48 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M.gguf.a with huggingface_hub about 2 months ago
Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M.gguf.b

1.95 GB
LFS

Upload Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M.gguf.b with huggingface_hub about 2 months ago
README.md

733 Bytes

Update README.md about 2 months ago