📙Paper: CodeT5 Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation 📚Publisher: EMNLP 🏠Author Affiliation: Salesforce Research Asia 🔑Public: ✅ ...

🗂️Benchmark Name: MBPP 📚Publisher: Arxiv 🏠Author Affiliation: Google Research 🔗URL: https://github.com/google-research/google-research/tree/master/mbpp Number of Instances: 974 Problem...

🗂️Benchmark Name: HumanEval 📚Publisher/Date: Arxiv/2022 🏠Author Affiliation: OpenAI 🔗URL: https://github.com/openai/human-eval Number of Instances: 164 Problem Description’s Natural La...

📙Paper: Evaluating Large Language Models Trained on Code 📚Publisher: Arxiv 🏠Author Affiliation: OpenAI 🔑Public: ❌ 🌐Architecture Encoder-Decoder Decoder-Only 📏M...

🗂️Benchmark Name: APPS 📚Publisher: NeurIPS 🏠Author Affiliation: UC Berkeley 🔗URL: https://github.com/hendrycks/apps Number of Instances: 5,000 Problem Description’s Natural Language: E...

📙Paper: GPT-J 📚Publisher: other 🏠Author Affiliation: EleutherAI 🔑Public: ✅ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 6B 🗂️Dat...

📙Paper: Unified Pre-training for Program Understanding and Generation 📚Publisher: NAACL 🏠Author Affiliation: University of California 🔑Public: ✅ 🌐Architecture Encoder-Decoder ...

📙Paper: MoTCoder Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks 📚Publisher: arxiv 🏠Author Affiliation: The Chinese University of Hong Kong; SmartMo...

📙Paper: GPT-Neo 📚Publisher: other 🏠Author Affiliation: EleutherAI 🔑Public: ✅ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 125M; 1.3B; 2.7B...

📙Paper: CodeXGLUE A Machine Learning Benchmark Dataset for Code Understanding and Generation 📚Publisher: NeurIPS 🏠Author Affiliation: Microsoft 🔑Public: ✅ 🌐Architecture Encode...