Hugging Face's logo

DrNicefellow
/
Qwen1.5-72B-Chat-8bpw-h8-exl2

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Qwen1.5-72B-Chat-8bpw-h8-exl2 / README.md
DrNicefellow's picture
DrNicefellow
Create README.md
c03f113 verified
preview code
|
raw
history blame contribute delete
833 Bytes
metadata
license: other
license_name: tongyi-qianwen
license_link: https://huggingface.co/Qwen/Qwen1.5-72B-Chat/blob/main/LICENSE

Qwen1.5-72B-Chat-8.0bpw-h8-exl2

This is a 8.0bpw/h8 quantized version of Qwen/Qwen1.5-72B-Chat made with exllamav2.

To run this, make sure you installed the up-to-date version of Exllamav2.

License

This project is distributed under the Tongyi Qianwen LICENSE AGREEMENT. See the LICENSE file for more information.

Feeling Generous? 😊

Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?