AWQ-Marlin Quantization Model

This model is based on the AWQ-Marlin quantization technique and is optimized for role-playing scenarios. It has been trained to generate dialogue and interactions in text-based RPGs. The model provides efficient performance without compromising on quality.

Use Cases

  • Role-playing Games (RPGs): Generate character dialogues and plot interactions in text-based RPGs.
Downloads last month
47
Safetensors
Model size
1.98B params
Tensor type
I32
·
FP16
·
Inference API
Unable to determine this model's library. Check the docs .