TheBloke
/

h2ogpt-oasst1-512-30B-GPTQ

Text Generation

large language model

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

list index out of range

#2 opened over 1 year ago by

Which GPTQ parameters to use? Is 512 groupsize or cutoff length?

#1 opened over 1 year ago by