Not-For-All-Audiences

Inference Endpoints

imatrix

conversational

Model card Files Files and versions Community

BADMISTRAL-1.5B-i1-GGUF

1 contributor

History: 26 commits

mradermacher

auto-patch README.md

480d553 verified 3 months ago

.gitattributes

2.96 kB

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ1_M.gguf

409 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ1_S.gguf

381 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ2_M.gguf

564 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ2_S.gguf

527 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ2_XS.gguf

496 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ2_XXS.gguf

455 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ3_M.gguf

727 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ3_S.gguf

705 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ3_XS.gguf

672 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ3_XXS.gguf

626 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-IQ4_XS.gguf

855 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q2_K.gguf

608 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q3_K_L.gguf

834 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q3_K_M.gguf

772 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q3_K_S.gguf

701 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q4_0.gguf

898 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q4_K_M.gguf

946 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q4_K_S.gguf

901 MB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q5_K_M.gguf

1.11 GB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q5_K_S.gguf

1.08 GB
LFS

uploaded from nethype/leia 3 months ago
BADMISTRAL-1.5B.i1-Q6_K.gguf

1.28 GB
LFS

uploaded from nethype/leia 3 months ago
README.md

4.91 kB

auto-patch README.md 3 months ago
imatrix.dat

1.79 MB
LFS

uploaded from nethype/leia 3 months ago