Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-Smaug-8B-GGUF
like
4
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
conversational
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
e5af55b
Llama-3-Smaug-8B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
affc6f97a8c182849e474a566d37629c16c8a80e6e4bf21e7bfcfa308576212c
e5af55b
verified
9 months ago
.gitattributes
2.17 kB
affc6f97a8c182849e474a566d37629c16c8a80e6e4bf21e7bfcfa308576212c
9 months ago
Llama-3-Smaug-8B.IQ3_XS.gguf
Safe
3.52 GB
LFS
57d481cb839ad5871f4dd8c8e58a2c019011ca7bd1a39bcfecde141e42fc4fb0
9 months ago
Llama-3-Smaug-8B.IQ4_XS.gguf
Safe
4.48 GB
LFS
808aa969f5c8129deb8ef63dfc41cb09163d5c4d42c5e5f681230065be7724ba
9 months ago
Llama-3-Smaug-8B.Q2_K.gguf
Safe
3.18 GB
LFS
8e786cd83a34faad8ec3ac0d1bd475ec82832627eadd1a66dc6c756c94eecc39
9 months ago
Llama-3-Smaug-8B.Q3_K_L.gguf
Safe
4.32 GB
LFS
98291d8ab1abe96f8b1939e006aa3883dffa622a3f04ce7cd94350488c805de1
9 months ago
Llama-3-Smaug-8B.Q3_K_M.gguf
Safe
4.02 GB
LFS
7a062b9c6f159c3a0f5718582c54b383fe436bfd862e318cc2e2c3d3d8d2bc3c
9 months ago
Llama-3-Smaug-8B.Q3_K_S.gguf
Safe
3.67 GB
LFS
1ca3d8a5086e71a726b3a317584461276a879233a0868ca55bf27d34451ed8bf
9 months ago
Llama-3-Smaug-8B.Q4_K_M.gguf
Safe
4.92 GB
LFS
7566ba13b6096752485e75d6fef6d7cbd9d658ce5166ff9619539ffdec2180ed
9 months ago
Llama-3-Smaug-8B.Q4_K_S.gguf
Safe
4.69 GB
LFS
fa098bfada8532d5b199bb2d61e8630d376c2f511c981f0b83fe5e23553620ae
9 months ago
Llama-3-Smaug-8B.Q5_K_M.gguf
Safe
5.73 GB
LFS
a4abb9a7b8ba4a8005b40dc3d98c226973cd4d814a17f9b354eb4f79291953d1
9 months ago
Llama-3-Smaug-8B.Q5_K_S.gguf
Safe
5.6 GB
LFS
affc6f97a8c182849e474a566d37629c16c8a80e6e4bf21e7bfcfa308576212c
9 months ago
