APPS

• 🗂️Benchmark Name: APPS
• 📚Publisher: NeurIPS
• 🏠Author Affiliation: UC Berkeley
• 🔗URL: https://github.com/hendrycks/apps
• Number of Instances: 5,000
• Problem Description’s Natural Language: English
• Code Solution’s Programming Language: Python
• Data Statistics
  • Test Case: ✅
  • Average Number of Test Cases: 21.0
  • Average Number of Characters in Problem Description: 1743.4
  • Average Number of Lines in Problem Description: 41.6
  • Average Number of Characters in Code Solution: 473.8
  • Average Number of Lines in Code Solution: 21.4
• Scenario: Competitions