Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
Midnight-Rose-103B-v2.0.3-i1-GGUF
like
4
Transformers
GGUF
English
Inference Endpoints
imatrix
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
b9a8749
Midnight-Rose-103B-v2.0.3-i1-GGUF
1 contributor
History:
9 commits
mradermacher
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
b9a8749
verified
11 months ago
.gitattributes
2.17 kB
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-IQ2_XS.gguf
30.7 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-IQ2_XXS.gguf
27.6 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-IQ3_XXS.gguf
40.5 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-Q2_K.gguf
38.2 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-Q3_K_M.gguf.split-aa
26.8 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-Q3_K_M.gguf.split-ab
23.1 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-Q4_K_M.gguf.split-aa
31.1 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
Midnight-Rose-103B-v2.0.3.i1-Q4_K_M.gguf.split-ab
31.1 GB
LFS
imatrix quantize of https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3
11 months ago
README.md
279 Bytes
Update README.md
11 months ago
