Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
MergerixInex12-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
a874467
MergerixInex12-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
cce494c135b4c15cf35ee29472cc4170928209cfea0f797b129c83ee1e5be5b6
a874467
verified
8 months ago
.gitattributes
Safe
2.24 kB
cce494c135b4c15cf35ee29472cc4170928209cfea0f797b129c83ee1e5be5b6
8 months ago
MergerixInex12-7B.Q2_K.gguf
Safe
2.72 GB
LFS
844340696e66c1ce008cd3013f021d19ecc5c55fb28ba1aea6605f94366a63ac
8 months ago
MergerixInex12-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
87b448b97a6f5fad4f02211f3a25b200fae00c31ef6f54d85b57a9189b68386a
8 months ago
MergerixInex12-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
736430a696eca99a437217e076a2f7b81640453d10eebd677a33b5ab2cbbd1c5
8 months ago
MergerixInex12-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
3d7240687fb0715a1b99d95876523da1c08ffbd2933dc5517d3192a1b82ad988
8 months ago
MergerixInex12-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
a49996d25f2f181096c5ae4610ad04a39a44319285e690a93962baf3776221ab
8 months ago
MergerixInex12-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
46e08c465eab6239a71b3a8bed3ac67fd797407b490f4315d684736d3dbbfba5
8 months ago
MergerixInex12-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
199fe4a0880c924e7286d0a46f3a26546335f00b781c929978091ae188ad611c
8 months ago
MergerixInex12-7B.Q5_K_S.gguf
Safe
5 GB
LFS
9a7c1694c1a1ba6bf9a4cd130ee966bfc9be3ac53398d621a8eb0f7d438113ce
8 months ago
MergerixInex12-7B.Q6_K.gguf
Safe
5.94 GB
LFS
eb21dd24a583312e0b5db5c22620d488722e8ea884925b2cab80bbaadea6022b
8 months ago
MergerixInex12-7B.Q8_0.gguf
Safe
7.7 GB
LFS
17296e5204995e186db24f51c2354ef0cd1f38f13614f3293ed105abd0c63b7d
8 months ago
MergerixInex12-7B.fp16.gguf
Safe
14.5 GB
LFS
cce494c135b4c15cf35ee29472cc4170928209cfea0f797b129c83ee1e5be5b6
8 months ago