Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
MixTAO-7Bx2-MoE-v8.1-GGUF
like
11
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
Mixture of Experts
Eval Results
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
007de10
MixTAO-7Bx2-MoE-v8.1-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
e22ffe20f3f05897cc8e8726393131eff2c1610063097d4aa3cafdbce94cc5e3
007de10
verified
10 months ago
.gitattributes
2 kB
e22ffe20f3f05897cc8e8726393131eff2c1610063097d4aa3cafdbce94cc5e3
10 months ago
MixTAO-7Bx2-MoE-v8.1.IQ4_XS.gguf
6.98 GB
LFS
4b28163765d2a5c315bdcaa3301cf38dfb14b26e7c5e99ecf78f794edd8dab34
10 months ago
MixTAO-7Bx2-MoE-v8.1.Q2_K.gguf
4.76 GB
LFS
8d47b9c5385a2dc8eb2c9be88206ebfb69b1dc76bd096d796762c6bfb82a5421
10 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_L.gguf
6.73 GB
LFS
fbbc5d324ce0fc2bc49486dfc969642c072e64ccb8fc450d227eed2ed9448812
10 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_M.gguf
6.21 GB
LFS
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
10 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_S.gguf
5.59 GB
LFS
0766c80af2c1e979e3f375d47d4b610b71f3c27965eb2e35df8045b317d028d0
10 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_M.gguf
7.78 GB
LFS
df6980b19c542d1f4aa9ce99aab0868c87960a86a60cc05dc216cc74edd4ae16
10 months ago
MixTAO-7Bx2-MoE-v8.1.Q4_K_S.gguf
7.34 GB
LFS
e22ffe20f3f05897cc8e8726393131eff2c1610063097d4aa3cafdbce94cc5e3
10 months ago
