Home MultiPL-MBPP
Post
Cancel

MultiPL-MBPP

  • 🗂️Benchmark Name: MultiPL-MBPP
  • 📚Publisher: Arxiv
  • 🔗URL: https://github.com/nuprl/MultiPL-E/tree/main/datasets
  • Number of Instances: 974 per programming language
  • Problem Description’s Natural Language: English
  • Code Solution’s Programming Language: Python, Bash, C++, C#, D, Go, Java, JavaScrpt, Julia, Lua, Perl, PHP, R, Racket, Ruby, Rust, Scala, Swift, TypeScript
  • Data Statistics
    • Test Case: ✅
    • Average Number of Test Cases: 3.1
    • Average Number of Characters in Problem Description: 181.2
    • Average Number of Lines in Problem Description: 5.4
    • Average Number of Characters in Code Solution: /
    • Average Number of Lines in Code Solution: /
  • Scenario: Multilingual
This post is licensed under CC BY 4.0 by the author.

MultiPL-HumanEval

CodeGeeX