TheBloke
/

gpt4-alpaca-lora-30B-GPTQ

Text2Text Generation

text-generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (3)

ModuleNotFoundError: No module named 'llama_inference_offload'

#6 opened almost 2 years ago by

gpt4-alpaca-lora-30B-GPTQ-4bit-128g only generate same Russian words

#5 opened almost 2 years ago by

Weights do not work (non-128g weights do work!)

#2 opened almost 2 years ago by