File size: 1,031 Bytes
9299432 978381f 9299432 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset.
Branches:
- `main` -- rpcal-`measurement.json`
Requires ExllamaV2 version 0.0.12 and up.
Original model link: [crestf411/daybreak-miqu-1-70b-v1.0-hf](https://huggingface.co/crestf411/daybreak-miqu-1-70b-v1.0-hf)
Original model README below.
***
Model trained on the same dataset as [daybreak-mixtral-8x7b](https://huggingface.co/crestf411/daybreak-mixtral-8x7b-v1.0-hf) except directly on miqu-1-70b.
Static and imatrix GGUF quants (thanks to [mradermacher](https://huggingface.co/mradermacher)):
* https://huggingface.co/mradermacher/daybreak-miqu-1-70b-v1.0-hf-GGUF
* https://huggingface.co/mradermacher/daybreak-miqu-1-70b-v1.0-hf-i1-GGUF
EXL2 quants:
* https://huggingface.co/crestf411/daybreak-miqu-1-70b-4.25bpw-v1.0-exl2
EXL2 measurements (for making your own quants): https://huggingface.co/crestf411/ExllamaV2-Measurements/blob/main/measurement-daybreak-miqu-1-70b-v1.0.json
|