Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
TinyMixtral-4x248M-MoE-i1-GGUF
like
1
Transformers
GGUF
English
Mixture of Experts
Merge
mergekit
lazymergekit
Felladrin/TinyMistral-248M-SFT-v4
Locutusque/LocutusqueXFelladrin-TinyMistral248M-Instruct
Locutusque/TinyMistral-248M-v2-Instruct
Locutusque/TinyMistral-248M-v2.5
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
1f046c9
TinyMixtral-4x248M-MoE-i1-GGUF
1 contributor
History:
4 commits
mradermacher
uploaded from rain
1f046c9
verified
24 days ago
.gitattributes
Safe
3.33 kB
uploaded from rain
24 days ago
README.md
Safe
239 Bytes
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ1_M.gguf
Safe
177 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ1_S.gguf
Safe
163 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ2_M.gguf
Safe
245 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ2_S.gguf
Safe
226 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ2_XS.gguf
Safe
220 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ2_XXS.gguf
Safe
200 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ3_M.gguf
Safe
319 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ3_S.gguf
Safe
315 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ3_XS.gguf
Safe
301 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ3_XXS.gguf
Safe
281 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ4_NL.gguf
Safe
404 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-IQ4_XS.gguf
Safe
383 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q2_K.gguf
Safe
270 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q2_K_S.gguf
Safe
252 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q3_K_L.gguf
Safe
371 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q3_K_M.gguf
Safe
344 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q3_K_S.gguf
Safe
315 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q4_0.gguf
Safe
405 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q4_1.gguf
Safe
446 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q4_K_M.gguf
Safe
430 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q4_K_S.gguf
Safe
406 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q5_K_M.gguf
Safe
501 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q5_K_S.gguf
Safe
487 MB
LFS
uploaded from rain
24 days ago
TinyMixtral-4x248M-MoE.i1-Q6_K.gguf
Safe
576 MB
LFS
uploaded from rain
24 days ago
imatrix.dat
1.43 MB
LFS
uploaded from rain
24 days ago
