Home MBPP
Post
Cancel

MBPP

  • 🗂️Benchmark Name: MBPP
  • 📚Publisher: Arxiv
  • 🏠Author Affiliation: Google Research
  • 🔗URL: https://github.com/google-research/google-research/tree/master/mbpp
  • Number of Instances: 974
  • Problem Description’s Natural Language: English
  • Code Solution’s Programming Language: Python
  • Data Statistics
    • Test Case: ✅
    • Average Number of Test Cases: 3.1
    • Average Number of Characters in Problem Description: 78.6
    • Average Number of Lines in Problem Description: 1.0
    • Average Number of Characters in Code Solution: 181.1
    • Average Number of Lines in Code Solution: 6.7
  • Scenario: Code Exercise
This post is licensed under CC BY 4.0 by the author.

HumanEval

CodeT5