Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment24Yam-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
157486c
Experiment24Yam-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
3c8f39932bc8f752490836ab19f192a840020f8425f98d6b709c0d08de629089
157486c
verified
10 months ago
.gitattributes
Safe
1.99 kB
3c8f39932bc8f752490836ab19f192a840020f8425f98d6b709c0d08de629089
10 months ago
Experiment24Yam-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
7cf875cdaff7d0b24619a8a580a068c57bd30d970175b1c4c39f18f89219dfff
10 months ago
Experiment24Yam-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
1754396caa698ff3d7fd780ac07640ef0f280cc584b2a78f69f0861e62b582c1
10 months ago
Experiment24Yam-7B.Q2_K.gguf
Safe
2.72 GB
LFS
ede570031b8d9af85043e61f9d99d8860f5e149416eb007df93783f6fed69625
10 months ago
Experiment24Yam-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
a39c934a44deac43cfdac2a5e64b4e75ce8ac43c33b1490afdf7a8861d8a711b
10 months ago
Experiment24Yam-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
e99104f9a072c4f757c9cc636858c03299ab43051136599b66094879a9721261
10 months ago
Experiment24Yam-7B.Q3_K_S.gguf
3.16 GB
LFS
9c3729d4bc286f11578cbd030f2a47c55bb0cf0d35d1451451a8c5681e80715b
10 months ago
Experiment24Yam-7B.Q4_K_M.gguf
4.37 GB
LFS
3c8f39932bc8f752490836ab19f192a840020f8425f98d6b709c0d08de629089
10 months ago