1 contributor

History: 34 commits

TheBloke

Upload new k-quant GGML quantised models.

8677424 over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

9.82 kB

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q2_K.bin

13.6 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q3_K_L.bin

17.2 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q3_K_M.bin

15.6 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q3_K_S.bin

14 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q4_0.bin

18.3 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q4_1.bin

20.3 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q4_K_M.bin

19.6 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q4_K_S.bin

18.3 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q5_0.bin

22.4 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q5_1.bin

24.4 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q5_K_M.bin

23 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q5_K_S.bin

22.4 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q6_K.bin

26.7 GB
LFS

Upload new k-quant GGML quantised models. over 1 year ago
h2ogptq-oasst1-512-30B.ggmlv3.q8_0.bin

34.6 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago