|
--- |
|
license: apache-2.0 |
|
tags: |
|
- finetuned |
|
- mlx |
|
- 4-bit |
|
pipeline_tag: text-generation |
|
inference: false |
|
--- |
|
|
|
# Mistral-7B-Instruct-v0.1-4bit-mlx |
|
This model was converted to MLX format from [`mistralai/Mistral-7B-Instruct-v0.1`](). |
|
Refer to the [original model card](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) for more details on the model. |
|
## Use with mlx |
|
```bash |
|
pip install mlx |
|
git clone https://github.com/ml-explore/mlx-examples.git |
|
cd mlx-examples/llms/hf_llm |
|
python generate.py --model mlx-community/Mistral-7B-Instruct-v0.1-4bit-mlx --prompt "My name is" |
|
``` |
|
|
