HumanEval-Infilling

• 🗂️Benchmark Name: HumanEval-Infilling
• 📚Publisher: arxiv
• 🏠Author Affiliation: OpenAI
• 🔗URL: https://www.github.com/openai/human-eval-infilling
• Number of Instances: 164
• Problem Description’s Natural Language: English
• Code Solution’s Programming Language: Python
• Data Statistics
  • Test Case: ✅
  • Average Number of Test Cases: 7.77
  • Average Number of Characters in Problem Description: /
  • Average Number of Lines in Problem Description: /
  • Average Number of Characters in Code Solution: /
  • Average Number of Lines in Code Solution: /
• Scenario: Fill in the Middle