Can you provide 4-bits version ?
#7
by
hanswang73
- opened
Can you provide 4-bits version ?
You can find the 4-bit AWQ version here:
https://huggingface.co/TheBloke/deepseek-llm-67b-chat-AWQ/tree/main
Can you provide 4-bits version ?
You can find the 4-bit AWQ version here:
https://huggingface.co/TheBloke/deepseek-llm-67b-chat-AWQ/tree/main