README.md

---
language:
- fr
- it
- de
- es
- en
license: apache-2.0
tags:
- moe
- llama-cpp
- gguf
extra_gated_description: If you want to learn more about how we process your personal
  data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
base_model: mistralai/Mixtral-8x22B-v0.1
---

# Supa-AI/Mixtral-8x22B-v0.1-gguf
This model was converted to GGUF format from [`mistralai/Mixtral-8x22B-v0.1`](https://huggingface.co/mistralai/Mixtral-8x22B-v0.1) using llama.cpp.
Refer to the [original model card](https://huggingface.co/mistralai/Mixtral-8x22B-v0.1) for more details on the model.

## Available Versions


## Use with llama.cpp
Replace `FILENAME` with one of the above filenames.

### CLI:
```bash
llama-cli --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -p "Your prompt here"
```

### Server:
```bash
llama-server --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -c 2048
```

## Model Details
- **Original Model:** [mistralai/Mixtral-8x22B-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-v0.1)
- **Format:** GGUF