English
yintongl commited on
Commit
f96032e
·
verified ·
1 Parent(s): c98d725

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -22
README.md CHANGED
@@ -16,6 +16,33 @@ Inference of this model is compatible with AutoGPTQ's Kernel.
16
 
17
 
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ### Evaluate the model
20
 
21
  Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id 96d185fa6232a5ab685ba7c43e45d1dbb3bb906d
@@ -42,28 +69,6 @@ lm_eval --model hf --model_args pretrained="Intel/SOLAR-10.7B-Instruct-v1.0-int4
42
 
43
 
44
 
45
- ### Reproduce the model
46
-
47
- Here is the sample command to reproduce the model
48
-
49
- ```bash
50
- git clone https://github.com/intel/auto-round
51
- cd auto-round/examples/language-modeling
52
- pip install -r requirements.txt
53
- python3 main.py \
54
- --model_name upstage/SOLAR-10.7B-Instruct-v1.0 \
55
- --device 0 \
56
- --group_size 128 \
57
- --bits 4 \
58
- --iters 1000 \
59
- --minmax_lr 2e-3 \
60
- --disable_quanted_input \
61
- --deployment_device 'gpu' \
62
- --output_dir "./tmp_autoround" \
63
-
64
- ```
65
-
66
-
67
 
68
 
69
 
 
16
 
17
 
18
 
19
+
20
+ ### Reproduce the model
21
+
22
+ Here is the sample command to reproduce the model
23
+
24
+ ```bash
25
+ git clone https://github.com/intel/auto-round
26
+ cd auto-round/examples/language-modeling
27
+ pip install -r requirements.txt
28
+ python3 main.py \
29
+ --model_name upstage/SOLAR-10.7B-Instruct-v1.0 \
30
+ --device 0 \
31
+ --group_size 128 \
32
+ --bits 4 \
33
+ --iters 1000 \
34
+ --minmax_lr 2e-3 \
35
+ --disable_quanted_input \
36
+ --deployment_device 'gpu' \
37
+ --output_dir "./tmp_autoround" \
38
+
39
+ ```
40
+
41
+
42
+
43
+
44
+
45
+
46
  ### Evaluate the model
47
 
48
  Install [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness.git) from source, we used the git id 96d185fa6232a5ab685ba7c43e45d1dbb3bb906d
 
69
 
70
 
71
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
 
73
 
74