Update README.md
Browse files
README.md
CHANGED
@@ -61,12 +61,12 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
|
|
61 |
| Model | HumanEval python pass@1 |
|
62 |
| --- |----------------------------------------------------------------------------- |
|
63 |
| CodeLlama-7b-hf | 30.5%|
|
64 |
-
| opencsg-CodeLlama-7b-v0.1 | **43.9%** |
|
65 |
| CodeLlama-13b-hf | 36.0%|
|
66 |
-
| opencsg-CodeLlama-13b-v0.1 | **51.2%** |
|
67 |
| CodeLlama-34b-hf | 48.2%|
|
68 |
-
| opencsg-CodeLlama-34b-v0.1
|
69 |
-
| opencsg-CodeLlama-34b-v0.
|
70 |
| CodeLlama-70b-hf| 53.0% |
|
71 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
72 |
|
@@ -176,12 +176,12 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准,尤
|
|
176 |
| 模型 | HumanEval python pass@1 |
|
177 |
| --- |----------------------------------------------------------------------------- |
|
178 |
| CodeLlama-7b-hf | 30.5%|
|
179 |
-
| opencsg-CodeLlama-7b-v0.1| **43.9%** |
|
180 |
| CodeLlama-13b-hf | 36.0%|
|
181 |
-
| opencsg-CodeLlama-13b-v0.1 | **51.2%** |
|
182 |
| CodeLlama-34b-hf | 48.2%|
|
183 |
-
| opencsg-CodeLlama-34b-v0.1
|
184 |
-
| opencsg-CodeLlama-34b-v0.
|
185 |
| CodeLlama-70b-hf| 53.0% |
|
186 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
187 |
|
|
|
61 |
| Model | HumanEval python pass@1 |
|
62 |
| --- |----------------------------------------------------------------------------- |
|
63 |
| CodeLlama-7b-hf | 30.5%|
|
64 |
+
| **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
|
65 |
| CodeLlama-13b-hf | 36.0%|
|
66 |
+
| **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
|
67 |
| CodeLlama-34b-hf | 48.2%|
|
68 |
+
| **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
|
69 |
+
| **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
|
70 |
| CodeLlama-70b-hf| 53.0% |
|
71 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
72 |
|
|
|
176 |
| 模型 | HumanEval python pass@1 |
|
177 |
| --- |----------------------------------------------------------------------------- |
|
178 |
| CodeLlama-7b-hf | 30.5%|
|
179 |
+
| **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
|
180 |
| CodeLlama-13b-hf | 36.0%|
|
181 |
+
| **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
|
182 |
| CodeLlama-34b-hf | 48.2%|
|
183 |
+
| **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
|
184 |
+
| **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
|
185 |
| CodeLlama-70b-hf| 53.0% |
|
186 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
187 |
|