mradermacher
/

Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens-i1-GGUF

1 contributor

History: 8 commits

mradermacher's picture

uploaded from rich1

63f3be8 verified 30 days ago

.gitattributes

2.07 kB

uploaded from rich1 30 days ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ3_M.gguf

4.06 GB
LFS

uploaded from rich1 30 days ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-IQ3_XXS.gguf

3.5 GB
LFS

uploaded from rich1 30 days ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q2_K.gguf

3.36 GB
LFS

uploaded from rich1 30 days ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q3_K_M.gguf

4.35 GB
LFS

uploaded from rich1 30 days ago
Mistral-7B-Instruct-v0.2-expanded-sec-1.6B-tokens.i1-Q4_K_S.gguf

5.13 GB
LFS

uploaded from rich1 30 days ago
README.md

266 Bytes

uploaded from rich1 30 days ago
imatrix.dat

6.24 MB
LFS

uploaded from rich1 30 days ago