saishf
/

DownSide-2x7B-Toxic-TOM-RP-GGUF

Inference Endpoints

Model card Files Files and versions Community

GGUF quants for https://huggingface.co/Undi95/DownSide-2x7B-Toxic-TOM-RP

No imatrix quants. Haven't wrapped my head around that yet.

Downloads last month: 1

GGUF

Model size

12.9B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .