Intel
/

Meta-Llama-3-8B-Instruct-int4-inc

Model card Files Files and versions Community

yintongl commited on Jul 4, 2024

Commit

dd09d31

·

verified ·

1 Parent(s): 35ef271

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ python3 main.py \
 --bits 4 \
 --iters 200 \
 --deployment_device 'gpu' \
---disable_low_gpu_mem_usage \
 --output_dir "./tmp_autoround"
 ```

 --bits 4 \
 --iters 200 \
 --deployment_device 'gpu' \
+--nsamples 512 \
 --output_dir "./tmp_autoround"
 ```