cicdatopea commited on
Commit
d9fa691
·
verified ·
1 Parent(s): 0c05727

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -6,7 +6,7 @@ base_model:
6
  ---
7
  ## Model Details
8
 
9
- This model is an int4 model with group_size 128 and and symmetric quantization of [deepseek-ai/DeepSeek-V2.5-1210](https://huggingface.co/deepseek-ai/DeepSeek-V2.5-1210) generated by [intel/auto-round](https://github.com/intel/auto-round) algorithm. Load the model with `revision="90bb8ef"` to use AutoGPTQ format. **Please note that loading the model in Transformers can be quite slow. Consider using an alternative server framework for better performance.**
10
 
11
  ## How To Use
12
 
 
6
  ---
7
  ## Model Details
8
 
9
+ This model is an int4 model with group_size 128 and and symmetric quantization of [deepseek-ai/DeepSeek-V2.5-1210](https://huggingface.co/deepseek-ai/DeepSeek-V2.5-1210) generated by [intel/auto-round](https://github.com/intel/auto-round) algorithm. Load the model with `revision="90bb8ef"` to use AutoGPTQ format. **Please note that loading the model in Transformers can be quite slow. Consider using an alternative serving framework for better performance.**
10
 
11
  ## How To Use
12