Hugging Face's logo

opencsg
/
opencsg-CodeLlama-13b-v0.1

Text Generation
Transformers
Safetensors
code
llama
llama-2
text-generation-inference
Inference Endpoints
Model card Files Community
AmeliaYin commited on
Commit
bef9822
·
verified ·
1 Parent(s): 7ab4f09

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -60,11 +60,11 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
60
  | Model | HumanEval python pass@1 |
61
  | --- |----------------------------------------------------------------------------- |
62
  | CodeLlama-7b-hf | 30.5%|
63
- | opencsg-CodeLlama-7b-v0.1(4k) | **42.7%** |
64
  | CodeLlama-13b-hf | 36.0%|
65
- | opencsg-CodeLlama-13b-v0.1(4k) | **45.1%** |
66
  | CodeLlama-34b-hf | 48.2%|
67
- | opencsg-CodeLlama-34b-v0.1(4k)| **48.8%** |
68
 
69
  **TODO**
70
  - We will provide more benchmark scores on fine-tuned models in the future.
@@ -170,11 +170,11 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准，尤
170
  | 模型 | HumanEval python pass@1 |
171
  | --- |----------------------------------------------------------------------------- |
172
  | CodeLlama-7b-hf | 30.5%|
173
- | opencsg-CodeLlama-7b-v0.1(4k) | **42.7%** |
174
  | CodeLlama-13b-hf | 36.0%|
175
- | opencsg-CodeLlama-13b-v0.1(4k) | **45.1%** |
176
  | CodeLlama-34b-hf | 48.2%|
177
- | opencsg-CodeLlama-34b-v0.1(4k)| **48.8%** |
178
 
179
  **TODO**
180
  - 未来我们将提供更多微调模型的在各基准上的分数。
 
60
  | Model | HumanEval python pass@1 |
61
  | --- |----------------------------------------------------------------------------- |
62
  | CodeLlama-7b-hf | 30.5%|
63
+ | opencsg-CodeLlama-7b-v0.1(4k) | **43.9%** |
64
  | CodeLlama-13b-hf | 36.0%|
65
+ | opencsg-CodeLlama-13b-v0.1(4k) | **51.2%** |
66
  | CodeLlama-34b-hf | 48.2%|
67
+ | opencsg-CodeLlama-34b-v0.1(4k)| **56.1%** |
68
 
69
  **TODO**
70
  - We will provide more benchmark scores on fine-tuned models in the future.
 
170
  | 模型 | HumanEval python pass@1 |
171
  | --- |----------------------------------------------------------------------------- |
172
  | CodeLlama-7b-hf | 30.5%|
173
+ | opencsg-CodeLlama-7b-v0.1(4k) | **43.9%** |
174
  | CodeLlama-13b-hf | 36.0%|
175
+ | opencsg-CodeLlama-13b-v0.1(4k) | **51.2%** |
176
  | CodeLlama-34b-hf | 48.2%|
177
+ | opencsg-CodeLlama-34b-v0.1(4k)| **56.1%** |
178
 
179
  **TODO**
180
  - 未来我们将提供更多微调模型的在各基准上的分数。