mradermacher
/

openthaigpt1.5-72b-instruct-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

openthaigpt1.5-72b-instruct-i1-GGUF

1 contributor

History: 17 commits

mradermacher's picture

uploaded from rich1

35930e2 verified 20 days ago

.gitattributes

2.76 kB

uploaded from rich1 20 days ago
README.md

247 Bytes

uploaded from rich1 21 days ago
imatrix.dat

25.2 MB
LFS

uploaded from rich1 21 days ago
openthaigpt1.5-72b-instruct.i1-IQ1_M.gguf

23.7 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-IQ2_M.gguf

29.3 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-IQ2_XXS.gguf

25.5 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-IQ3_M.gguf

35.5 GB
LFS

uploaded from rich1 21 days ago
openthaigpt1.5-72b-instruct.i1-IQ3_XXS.gguf

31.8 GB
LFS

uploaded from rich1 21 days ago
openthaigpt1.5-72b-instruct.i1-IQ4_XS.gguf

39.7 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q2_K.gguf

29.8 GB
LFS

uploaded from rich1 21 days ago
openthaigpt1.5-72b-instruct.i1-Q2_K_S.gguf

29.6 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q3_K_L.gguf

39.5 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q3_K_M.gguf

37.7 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q3_K_S.gguf

34.5 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q4_K_M.gguf

47.4 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q4_K_S.gguf

43.9 GB
LFS

uploaded from rich1 21 days ago
openthaigpt1.5-72b-instruct.i1-Q6_K.gguf.part1of2
32.2 GB
LFS

uploaded from rich1 20 days ago
openthaigpt1.5-72b-instruct.i1-Q6_K.gguf.part2of2
32.1 GB
LFS

uploaded from rich1 20 days ago