HumanEval-X

Posted Sep 19, 2022

By Anonymous

1 min read

🗂️Benchmark Name: HumanEval-X
📚Publisher: other
🏠Author Affiliation: Tsinghua University
🔗URL: https://github.com/THUDM/CodeGeeX/blob/main/codegeex/benchmark/README.md
Number of Instances: 164 per programming language
Problem Description’s Natural Language: English
Code Solution’s Programming Language: Python, C++, Java, JavaScript, Go
Data Statistics
- Test Case: ✅
- Average Number of Test Cases: 7.8
- Average Number of Characters in Problem Description: 468.4
- Average Number of Lines in Problem Description: 15.5
- Average Number of Characters in Code Solution: 264.6
- Average Number of Lines in Code Solution: 12.1
Scenario: Multilingual

This post is licensed under CC BY 4.0 by the author.