Qwen
/

Qwen-7B-Chat-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

Qwen-7B-Chat-Int4 / triton_kernels.py

Commit History

Update README of branch dev_triton.

575c4e9

Shangming Cai commited on Dec 26, 2023

Add ApplyRoPE and RMSNorm kernels written in OpenAI Triton.

1b59f63

wangzihan99 commited on Dec 4, 2023