--- license: llama3.2 tags: - llama3.2 - llama3.2-3B - rkllm - rockchip - rk3588 --- # Llama 3.2 3B for RK3588 This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU. **RKLLM runtime 1.1.1** requires **NPU driver 0.9.6**: - [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.1) - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8_g512-toolkitv1.1.1) **RKLLM runtime 1.1.4** requires **NPU driver 0.9.8**: - [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.4) - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588//tree/w8a8_g512-toolkitv1.1.4) # License Same as the original LLM: https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt