Hugging Face's logo

MarinaraSpaghetti
/
Doctor-Shotgun_Nous-Capybara-limarpv3-34B-4.2bpw-h6-exl2

Text Generation
Transformers
Safetensors
llama
roleplay
text-generation-inference
Inference Endpoints
Model card Files Community
2

Model Card for Model ID

My first exl2 quant of my favourite go-to roleplaying model. Can fit into my empty 24GB VRAM with 32k context in 8-bit cache. Might do a 4.25bpw quant later.

Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B

Prompt format: https://github.com/tatsu-lab/stanford_alpaca

Downloads last month
4
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train MarinaraSpaghetti/Doctor-Shotgun_Nous-Capybara-limarpv3-34B-4.2bpw-h6-exl2

Collection including MarinaraSpaghetti/Doctor-Shotgun_Nous-Capybara-limarpv3-34B-4.2bpw-h6-exl2