TomPei commited on
Commit
079af39
·
verified ·
1 Parent(s): 4920b2e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -61,12 +61,12 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
61
  | Model | HumanEval python pass@1 |
62
  | --- |----------------------------------------------------------------------------- |
63
  | CodeLlama-7b-hf | 30.5%|
64
- | opencsg-CodeLlama-7b-v0.1 | **43.9%** |
65
  | CodeLlama-13b-hf | 36.0%|
66
- | opencsg-CodeLlama-13b-v0.1 | **51.2%** |
67
  | CodeLlama-34b-hf | 48.2%|
68
- | opencsg-CodeLlama-34b-v0.1| **56.1%** |
69
- | opencsg-CodeLlama-34b-v0.1| **64.0%** |
70
  | CodeLlama-70b-hf| 53.0% |
71
  | CodeLlama-70b-Instruct-hf| **67.8%** |
72
 
@@ -176,12 +176,12 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准,尤
176
  | 模型 | HumanEval python pass@1 |
177
  | --- |----------------------------------------------------------------------------- |
178
  | CodeLlama-7b-hf | 30.5%|
179
- | opencsg-CodeLlama-7b-v0.1| **43.9%** |
180
  | CodeLlama-13b-hf | 36.0%|
181
- | opencsg-CodeLlama-13b-v0.1 | **51.2%** |
182
  | CodeLlama-34b-hf | 48.2%|
183
- | opencsg-CodeLlama-34b-v0.1| **56.1%** |
184
- | opencsg-CodeLlama-34b-v0.1| **64.0%** |
185
  | CodeLlama-70b-hf| 53.0% |
186
  | CodeLlama-70b-Instruct-hf| **67.8%** |
187
 
 
61
  | Model | HumanEval python pass@1 |
62
  | --- |----------------------------------------------------------------------------- |
63
  | CodeLlama-7b-hf | 30.5%|
64
+ | **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
65
  | CodeLlama-13b-hf | 36.0%|
66
+ | **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
67
  | CodeLlama-34b-hf | 48.2%|
68
+ | **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
69
+ | **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
70
  | CodeLlama-70b-hf| 53.0% |
71
  | CodeLlama-70b-Instruct-hf| **67.8%** |
72
 
 
176
  | 模型 | HumanEval python pass@1 |
177
  | --- |----------------------------------------------------------------------------- |
178
  | CodeLlama-7b-hf | 30.5%|
179
+ | **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
180
  | CodeLlama-13b-hf | 36.0%|
181
+ | **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
182
  | CodeLlama-34b-hf | 48.2%|
183
+ | **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
184
+ | **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
185
  | CodeLlama-70b-hf| 53.0% |
186
  | CodeLlama-70b-Instruct-hf| **67.8%** |
187