Hugging Face's logo

xxx777xxxASD
/
PrimaSumika-10.7B-128k-bpw-6.0

Text Generation
Transformers
Safetensors
English
mistral
Merge
Mixture of Experts
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
xxx777xxxASD commited on
Commit
7f201ed
·
verified ·
1 Parent(s): 34835bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -8,4 +8,5 @@ tags:
8
  ---
9
  ![image/png](https://i.ibb.co/71BdpSQ/00005-1478892296.png)
10
 
11
- ExLlamaV2 BPW 6.0 quant of [xxx777xxxASD/PrimaSumika-10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaSumika-10.7B-128k)
 
 
8
  ---
9
  ![image/png](https://i.ibb.co/71BdpSQ/00005-1478892296.png)
10
 
11
+ ExLlamaV2 BPW 6.0 quant of [xxx777xxxASD/PrimaSumika-10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaSumika-10.7B-128k)
12
+ (Fits in 12GB VRAM/42k context/4-bit cache)