📙Paper: PanGu-Coder Program Synthesis with Function-Level Language Modeling 📚Publisher: arxiv 🏠Author Affiliation: Huawei 🔑Public: ❌ 🌐Architecture Encoder-Decoder Decode...
CodeRL
📙Paper: CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning 📚Publisher: NeurIPS 🏠Author Affiliation: Salesforce Research 🔑Public: ✅ 🌐Architecture ...
CodeComplex
🗂️Benchmark Name: CodeComplex 📚Publisher: other 🏠Author Affiliation: Yonsei University 🔗URL: https://github.com/yonsei-toc/CodeComple Number of Instances: 4,200 Problem Description’s N...
InCoder
📙Paper: InCoder A Generative Model for Code Infilling and Synthesis 📚Publisher: arxiv 🏠Author Affiliation: Facebook AI Research 🔑Public: ✅ 🌐Architecture Encoder-Decoder ...
PaLM-Coder
📙Paper: PaLM Scaling Language Modeling with Pathways 📚Publisher: arxiv 🏠Author Affiliation: Google Research 🔑Public: ❌ 🌐Architecture Encoder-Decoder Decoder-Only ...
GSM8K-Python
🗂️Benchmark Name: GSM8K-Python 📚Publisher: Arxiv 🏠Author Affiliation: Google Research 🔗URL: https://github.com/openai/grade-school-math* Number of Instances: 1,000 Problem Description’...
BIG-Bench
🗂️Benchmark Name: PandasEval 📚Publisher: arxiv 🏠Author Affiliation: Google Research 🔗URL: https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/python_programming_challeng...
GPT-NeoX
📙Paper: GPT-NeoX-20B An Open-Source Autoregressive Language Model 📚Publisher: ACL 🏠Author Affiliation: EleutherAI 🔑Public: ✅ 🌐Architecture Encoder-Decoder Decoder-Only ...
MTPB
🗂️Benchmark Name: MTPB 📚Publisher: arxiv 🏠Author Affiliation: Salesforce Research 🔗URL: https://github.com/salesforce/CodeGen/tree/main/benchmark Number of Instances: 115 Problem Descr...
CodeGen
📙Paper: CodeGen An Open Large Language Model for Code with Multi-Turn Program Synthesis 📚Publisher: arxiv 🏠Author Affiliation: Salesforce Research 🔑Public: ✅ 🌐Architecture Enc...