File size: 525 Bytes
95328a4
 
 
 
 
 
 
 
 
5240204
95328a4
 
 
5240204
 
95328a4
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
language:
- en
license: apache-2.0
tags:
- llava
- multimodal
- qwen
- mlx
- mlx
---

# mlx-community/nanoLLaVA-1.5-4bit
This model was converted to MLX format from [`mlx-community/nanoLLaVA-1.5-bf16`]() using mlx-vlm version **0.1.6**.
Refer to the [original model card](https://huggingface.co/mlx-community/nanoLLaVA-1.5-bf16) for more details on the model.
## Use with mlx

```bash
pip install -U mlx-vlm
```

```bash
python -m mlx_vlm.generate --model mlx-community/nanoLLaVA-1.5-4bit --max-tokens 100 --temp 0.0
```