HumanEval

• 🗂️Benchmark Name: HumanEval
• 📚Publisher/Date: Arxiv/2022
• 🏠Author Affiliation: OpenAI
• 🔗URL: https://github.com/openai/human-eval
• Number of Instances: 164
• Problem Description’s Natural Language: English
• Code Solution’s Programming Language: Python
• Data Statistics
  • Test Case: ✅
  • Average Number of Test Cases: 7.8
  • Average Number of Characters in Problem Description: 450.6
  • Average Number of Lines in Problem Description: 13.7
  • Average Number of Characters in Code Solution: 180.9
  • Average Number of Lines in Code Solution: 6.8
• Scenario: Code Exercise