CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
Paper
•
2501.01257
•
Published
•
30
BigCode
Enterprise
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
bigcode's activity
huybery
authored
a
paper
about 13 hours ago
DeividasM
authored
a
paper
4 days ago
Fairness?
2
#9 opened 8 days ago
by
ordisbold
Human baseline
1
#8 opened 9 days ago
by
Ouz-G
terryyz
updated
10
datasets
9 days ago
bigcode/bigcodebench-hard-results
Viewer
•
Updated
•
160
•
61
bigcode/bigcodebench-hard-elo
Viewer
•
Updated
•
264
•
58
bigcode/bigcodebench-results
Viewer
•
Updated
•
160
•
71
•
1
bigcode/bigcodebench-elo
Viewer
•
Updated
•
218
•
73
bigcode/bigcodebench-hard-solve-rate
Viewer
•
Updated
•
296
•
59
bigcode/bigcodebench-hard-domain
Viewer
•
Updated
•
291
•
53
bigcode/bigcodebench-hard-perf
Viewer
•
Updated
•
291
•
55
bigcode/bigcodebench-solve-rate
Viewer
•
Updated
•
2.28k
•
63
bigcode/bigcodebench-domain
Viewer
•
Updated
•
245
•
55
bigcode/bigcodebench-perf
Viewer
•
Updated
•
245
•
51
terryyz
updated
a
Space
9 days ago
huybery
authored
5
papers
12 days ago
Iterative Forward Tuning Boosts In-Context Learning in Language Models
Paper
•
2305.13016
•
Published
PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts
Paper
•
2305.14839
•
Published
•
1
One Shot Learning as Instruction Data Prospector for Large Language Models
Paper
•
2312.10302
•
Published
•
3
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper
•
2406.15877
•
Published
•
45
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning
Paper
•
2301.13808
•
Published