Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.8-GGUF
like
4
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
llama-3
conversational
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
refs/pr/1
Llama-3-8B-Instruct-v0.8-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
ed305344703bb20883f5ddd2ab304b68e3e6d72e61573789151326bc7fc39075
5aa132b
verified
9 months ago
.gitattributes
2.24 kB
6d79196ee2368f6777c386727cd4bfd7e56902f2128722cfce7ab9310684047a
9 months ago
Llama-3-8B-Instruct-v0.8.Q2_K.gguf
3.18 GB
LFS
483c04ca7fb50b716be228873a407503b86912df6782106e2718ade1ffea94d8
9 months ago
Llama-3-8B-Instruct-v0.8.Q3_K_L.gguf
4.32 GB
LFS
1254116868df57fda850b204893d6894a09a7ef96c4568794a6ce538494690ce
9 months ago
Llama-3-8B-Instruct-v0.8.Q3_K_M.gguf
4.02 GB
LFS
fe3a9bfa65b58314995ac123fa0a4c86dabb29a13db4a711c8546f62ab614011
9 months ago
Llama-3-8B-Instruct-v0.8.Q3_K_S.gguf
3.67 GB
LFS
0d5ab35509fee9cc43b7ada9b157207dc28955ad8359d8362790d834decbf62b
9 months ago
Llama-3-8B-Instruct-v0.8.Q4_K_M.gguf
4.92 GB
LFS
aa2d7d1d9e577026d0abed2d7232c25e811001fa5936528bd7084cdc737961e2
9 months ago
Llama-3-8B-Instruct-v0.8.Q4_K_S.gguf
4.69 GB
LFS
d95ae79e2cc7014bc561095897a7b7eca0e9f7bdaec96e07f85124f34de0c749
9 months ago
Llama-3-8B-Instruct-v0.8.Q5_K_M.gguf
5.73 GB
LFS
b2addd22adb427b8c3e79bf8baabe292b4a17b7ee3a428e73a4f3377678b6bd3
9 months ago
Llama-3-8B-Instruct-v0.8.Q5_K_S.gguf
5.6 GB
LFS
33c9541845a8835154883808555b658cee8cc04d0d89f782a4d575a82d08be33
9 months ago
Llama-3-8B-Instruct-v0.8.Q6_K.gguf
6.6 GB
LFS
15d44eaf8325fb563361829b1095d26cada901d7cddbe8c179e6615f59a35665
9 months ago
Llama-3-8B-Instruct-v0.8.Q8_0.gguf
8.54 GB
LFS
6d79196ee2368f6777c386727cd4bfd7e56902f2128722cfce7ab9310684047a
9 months ago
README.md
3.08 kB
ed305344703bb20883f5ddd2ab304b68e3e6d72e61573789151326bc7fc39075
9 months ago
