MBXP

• 🗂️Benchmark Name: MBXP
• 📚Publisher: Arxiv
• 🏠Author Affiliation: AWS AI Labs
• 🔗URL: https://github.com/amazon-research/mbxp-exec-eval
• Number of Instances: 974 per programming language
• Problem Description’s Natural Language: English
• Code Solution’s Programming Language: Python, Java, JavaScript, TypeScript, Go, Ruby, Kotlin, PHP, C#, Scala, C++, Swift, Perl
• Data Statistics
  • Test Case: ✅
  • Average Number of Test Cases: 3.1
  • Average Number of Characters in Problem Description: 419.9
  • Average Number of Lines in Problem Description: 14.8
  • Average Number of Characters in Code Solution: /
  • Average Number of Lines in Code Solution: /
• Scenario: Multilingual