TorchDataEval

• 🗂️Benchmark Name: TorchDataEval
• 📚Publisher: EMNLP
• 🏠Author Affiliation: Microsoft
• 🔗URL: https://github.com/microsoft/PyCodeGPT/tree/main/apicoder/private-eval/data
• Number of Instances: 50
• Problem Description’s Natural Language: English
• Code Solution’s Programming Language: Python
• Data Statistics
  • Test Case: ✅
  • Average Number of Test Cases: 1.1
  • Average Number of Characters in Problem Description: 329.0
  • Average Number of Lines in Problem Description: 8.6
  • Average Number of Characters in Code Solution: 50.7
  • Average Number of Lines in Code Solution: 1.3
• Scenario: Private Library