Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
mathstral-7B-v0.1-GGUF
like
7
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
ebfe16c
mathstral-7B-v0.1-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
e5f74241ffdb4741699724f33b78cc364cbd2e586d2f8c92dd6d0cb3e517bf45
ebfe16c
verified
6 months ago
.gitattributes
2.57 kB
e5f74241ffdb4741699724f33b78cc364cbd2e586d2f8c92dd6d0cb3e517bf45
6 months ago
README.md
2.96 kB
e266546623f45eb0851454548503ced1edac6b425be9ee7151cbde1c7713e560
6 months ago
mathstral-7B-v0.1-GGUF_imatrix.dat
4.99 MB
LFS
e266546623f45eb0851454548503ced1edac6b425be9ee7151cbde1c7713e560
6 months ago
mathstral-7B-v0.1.IQ1_M.gguf
1.76 GB
LFS
e266546623f45eb0851454548503ced1edac6b425be9ee7151cbde1c7713e560
6 months ago
mathstral-7B-v0.1.IQ2_XS.gguf
2.2 GB
LFS
51e712a3b42d83d2305637b3b3fdb69e0653579d22a71457a78ccd4efe4d7533
6 months ago
mathstral-7B-v0.1.IQ3_XS.gguf
3.02 GB
LFS
92137493a565dd1182d49f411e1c09d8cd36d8f422ae275b77ebdcd6c277ca68
6 months ago
mathstral-7B-v0.1.IQ4_XS.gguf
3.91 GB
LFS
8e312857bf506dddea88e468002363a2959455979035c17d1f9c9d999d016d8c
6 months ago
mathstral-7B-v0.1.Q2_K.gguf
2.72 GB
LFS
fe85905d7dda85fb7b35c11945ff2278c89bb5e45d4201d7c748084ecf501f8e
6 months ago
mathstral-7B-v0.1.Q3_K_L.gguf
3.83 GB
LFS
78c544e2e2fddd93566f2eb240b61f71b061c75b47ab3ea872c44cf439db329a
6 months ago
mathstral-7B-v0.1.Q3_K_M.gguf
3.52 GB
LFS
1cda21ccaf2fa0054c116e9ee618ff3c1f5b19c9a9bc5df0b5d94e381091e220
6 months ago
mathstral-7B-v0.1.Q3_K_S.gguf
3.17 GB
LFS
477888e037f7ec764687f643c9793794a3f5477a210ef9b0eccd7a3ad693e2ab
6 months ago
mathstral-7B-v0.1.Q4_K_M.gguf
4.37 GB
LFS
633cbb0385c0e7eb348f3cbf09138447b3e5ad5701a7685ff25dd21be9f8a6df
6 months ago
mathstral-7B-v0.1.Q4_K_S.gguf
4.14 GB
LFS
9e146b2594990ba200bf525162ab3ab02b4424c192965a03fe55a9236e137b9c
6 months ago
mathstral-7B-v0.1.Q5_K_M.gguf
5.14 GB
LFS
61a081442fb25db71bc795a966ab2319612ac9769c924a0d3121526ba94f0491
6 months ago
mathstral-7B-v0.1.Q5_K_S.gguf
5 GB
LFS
bde366ded56e73059de56eb90b1c4b80abfc5bfa5d5fd3877c7370cdca1de47b
6 months ago
mathstral-7B-v0.1.Q6_K.gguf
5.95 GB
LFS
7cc1e04003720ca860de76d5a3cf0e6385f850c05c073a6a859158351af07b62
6 months ago
mathstral-7B-v0.1.Q8_0.gguf
7.7 GB
LFS
8a2c4bc08c7355234ed23358655f24d90bf2e95c6cd7222dd7f358f826454751
6 months ago
mathstral-7B-v0.1.fp16.gguf
14.5 GB
LFS
e5f74241ffdb4741699724f33b78cc364cbd2e586d2f8c92dd6d0cb3e517bf45
6 months ago
