Supa-AI commited on
Commit
6ed7d6b
·
verified ·
1 Parent(s): 05842d4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - fr
4
+ - it
5
+ - de
6
+ - es
7
+ - en
8
+ license: apache-2.0
9
+ tags:
10
+ - moe
11
+ - llama-cpp
12
+ - gguf
13
+ extra_gated_description: If you want to learn more about how we process your personal
14
+ data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
15
+ base_model: mistralai/Mixtral-8x22B-v0.1
16
+ ---
17
+
18
+ # Supa-AI/Mixtral-8x22B-v0.1-gguf
19
+ This model was converted to GGUF format from [`mistralai/Mixtral-8x22B-v0.1`](https://huggingface.co/mistralai/Mixtral-8x22B-v0.1) using llama.cpp.
20
+ Refer to the [original model card](https://huggingface.co/mistralai/Mixtral-8x22B-v0.1) for more details on the model.
21
+
22
+ ## Available Versions
23
+
24
+
25
+ ## Use with llama.cpp
26
+ Replace `FILENAME` with one of the above filenames.
27
+
28
+ ### CLI:
29
+ ```bash
30
+ llama-cli --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -p "Your prompt here"
31
+ ```
32
+
33
+ ### Server:
34
+ ```bash
35
+ llama-server --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -c 2048
36
+ ```
37
+
38
+ ## Model Details
39
+ - **Original Model:** [mistralai/Mixtral-8x22B-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-v0.1)
40
+ - **Format:** GGUF