OPEA
/

DeepSeek-V3-int4-sym-gptq-inc

4-bit precision

Model card Files Files and versions Community

cicdatopea commited on 8 days ago

Commit

f4b9e09

·

verified ·

1 Parent(s): 28777a1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -42,7 +42,7 @@ model = AutoModelForCausalLM.from_pretrained(
     trust_remote_code=True,
     device_map="cpu",
     revision="8fe0735",##use autoround format, the only difference is config.json
-    quantization_config = quantization_config, ##cpu only machine could not set this
 )

     trust_remote_code=True,
     device_map="cpu",
     revision="8fe0735",##use autoround format, the only difference is config.json
+    quantization_config = quantization_config, ##cpu only machine don't need to set this value
 )