metadata

language:
  - fr
  - it
  - de
  - es
  - en
license: apache-2.0
tags:
  - moe
  - llama-cpp
  - gguf
extra_gated_description: >-
  If you want to learn more about how we process your personal data, please read
  our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
base_model: mistralai/Mixtral-8x22B-v0.1

Supa-AI/Mixtral-8x22B-v0.1-gguf

This model was converted to GGUF format from mistralai/Mixtral-8x22B-v0.1 using llama.cpp. Refer to the original model card for more details on the model.

Available Versions

Use with llama.cpp

Replace FILENAME with one of the above filenames.

CLI:

llama-cli --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -p "Your prompt here"

Server:

llama-server --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -c 2048

Model Details

Original Model: mistralai/Mixtral-8x22B-v0.1
Format: GGUF