TheBloke
/

OpenAssistant-SFT-7-Llama-30B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

OpenAssistant-SFT-7-Llama-30B-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

d92da4e

TheBloke commited on Aug 21, 2023

Upload new GPTQs with varied parameters

48dc04c

TheBloke commited on Jul 12, 2023

New GPTQ with no groupsize.

eeafeca

TheBloke commited on May 14, 2023