bartowski
/

Monstral-123B-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Monstral-123B-GGUF

1 contributor

History: 18 commits

bartowski's picture

Upload Monstral-123B-IQ2_XXS.gguf with huggingface_hub

a613fcf verified 3 months ago

Monstral-123B-IQ3_M
Upload folder using huggingface_hub 3 months ago
Monstral-123B-IQ4_XS
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q3_K_L
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q3_K_M
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q3_K_S
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q3_K_XL
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q4_0
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q4_K_M
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q5_K_M
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q6_K
Upload folder using huggingface_hub 3 months ago
Monstral-123B-Q8_0
Upload folder using huggingface_hub 3 months ago
.gitattributes

4.4 kB

Upload Monstral-123B-IQ2_XXS.gguf with huggingface_hub 3 months ago
Monstral-123B-IQ2_M.gguf

41.6 GB
LFS

Upload Monstral-123B-IQ2_M.gguf with huggingface_hub 3 months ago
Monstral-123B-IQ2_XS.gguf

36.1 GB
LFS

Upload Monstral-123B-IQ2_XS.gguf with huggingface_hub 3 months ago
Monstral-123B-IQ2_XXS.gguf

32.4 GB
LFS

Upload Monstral-123B-IQ2_XXS.gguf with huggingface_hub 3 months ago
Monstral-123B-IQ3_XXS.gguf

47 GB
LFS

Upload Monstral-123B-IQ3_XXS.gguf with huggingface_hub 3 months ago
Monstral-123B-Q2_K.gguf

45.2 GB
LFS

Upload Monstral-123B-Q2_K.gguf with huggingface_hub 3 months ago
Monstral-123B-Q2_K_L.gguf

45.6 GB
LFS

Upload Monstral-123B-Q2_K_L.gguf with huggingface_hub 3 months ago